An Irradiance-Adaptable Near-Infrared Vertical Heterojunction Phototransistor

In-sensor multilevel image adjustment for high-clarity contour extraction using adjustable synaptic phototransistors

Robotic vision has traditionally relied on high-performance yet resource-intensive computing solutions, which necessitate high-throughput data transmission from vision sensors to remote computing servers, sacrificing energy efficiency and processing speed. A promising solution is data compaction through contour extraction, visualizing only the outlines of objects while eliminating superfluous backgrounds. Here, we introduce an in-sensor multilevel image adjustment method using adjustable synaptic phototransistors, enabling the capture of well-defined images with optimal brightness and contrast suitable for achieving high-clarity contour extraction. This is enabled by emulating dopamine-mediated neuronal excitability regulation mechanisms. Electrostatic gating effect either facilitates or inhibits time-dependent photocurrent accumulation, adjusting photo-responses to varying lighting conditions. Through excitatory and inhibitory modes, the adjustable synaptic phototransistor enhances visibility of dim and bright regions, respectively, facilitating distinct contour extraction and high-accuracy semantic segmentation. Evaluations using road images demonstrate improvement of both object detection accuracy and intersection over union, and compression of data volume.

Infrared In-Sensor Computing Based on Flexible Photothermoelectric Tellurium Nanomesh Arrays

The inherent limitations of traditional von Neumann architectures hinder the rapid development of internet of things technologies. Beyond conventional, complementary metal-oxide-semiconductor technologies, imaging sensors integrated with near- or in-sensor computing architectures emerge as a promising solution. In this study, the multi-scale van der Waals (vdWs) interactions in 1D tellurium (Te) atomic chains are explored, leading to the deposition of a photothermoelectric (PTE) Te nanomesh on a polymeric polyimide substrate. The self-welding process enables the lateral vapor growth of a well-connected Te nanomesh with robust electrical and mechanical properties, including a PTE responsivity of ≈120 V W-1 in the infrared light regime. Leveraging the PTE operation, the thermal-coupled bi-directional photoresponse is investigated to demonstrate a proof-of-principle in-sensor convolutional network for edge computing. This work presents a scalable approach for assembling functional vdWs Te nanomesh and highlights its potential applications in PTE image sensing and convolutional processing.

A Self-Powered Organic Vision Sensor Array for Photopic Adaptation

With the rapid development of artificial intelligence, it is essential to develop a bionic vision sensor that boasts low power consumption, self-adaptability, and broadband sensing for efficient image preprocessing. We employed an organic p-type semiconductor, poly(3-hexylthiophene-2,5-diyl) (P3HT), in conjunction with an Al electrode to engineer a Schottky junction. This design leverages the photogating effect due to the charge trapping by defects at the P3HT/Al interface, endowing this self-powered, two-terminal device with photopic adaptability. The 1.9 eV bandgap of P3HT enables substantial light absorption within the visible spectrum, yielding a significant photocurrent. By assembling 50 photoelectric sensors into a 10 × 5 array, we successfully demonstrated an image formation process that emulates photopic adaptation, specifically in recognizing letters. This easily fabricated, self-powered retinomorphic photoelectric device has great potential to mimic retinal structures, thereby heralding a new frontier in visual sensory devices.

Diffusion limited synthesis of wafer-scale covalent organic framework films for adaptative visual device

Synthesizing high-crystalline covalent organic framework films is highly desired to advance their applications in two-dimensional optoelectronics, but it remains a great challenge. Here, we report a diffusion-limited synthesis strategy for wafer-scale uniform covalent organic framework films, in which pre-deposited 4,4',4″,4‴-(1,3,6,8-Tetrakis(4-aminophenyl) pyrene is encapsulated on substrate surface with a layer of covalent organic framework prepolymer. The polymer not only prevents the dissolution of precursor, but limits the reaction with terephthalaldehyde dissolved in solution, thereby regulating the polymerization process. The size depends on growth substrates, and 4-inch films have been synthesized on silicon chips. Their structure, thickness, patterning and crystallization degree can be controlled by adjusting building blocks and polymerization chemistries, and molybdenum disulfide have been used as substrates to construct vertical heterostructure. The measurements reveal that using covalent organic framework as a photosensitive layer, the heterojunction displays enhanced photoelectric performance, which can be used to simulate the adaptative function of visual system.

An Antagonistic Photovoltaic Memristor for Bioinspired Active Contrast Adaptation

Machine vision systems that consist of cameras and image-processing components for visual inspection and identification tasks play a critical role in various intelligent applications, including pilotless vehicles and surveillance systems. However, current systems usually possess a limited dynamic range and fixed photoresponsivity, restricting their capability of gaining high-fidelity images when encoding a high-contrast scene. Here, it is shown that a photovoltaic memristor incorporating two antagonistic photovoltaic junctions can autonomously adjust its response to varying light stimuli, enabling the amplification of shadows and inhibition of highlight saturation. Due to the dynamic photodoping effect at the p-n junction with an asymmetrical profile, the photocurrent polarities of the antagonistic memristor can be changed as the light intensity increases. The light-intensity-dependent switchable photovoltaic behaviors match Weber's law where photosensitivity is inversely proportional to the light stimuli. An 11 × 11 memristor array is used to detect a high-contrast scene with light intensities ranging from 1 to 5 × 104 µW cm-2, achieving a similar active contrast adaptation performance compared with the human visual systems (less than 1.2 s at 94 dB). This work paves the way for innovative neuromorphic device designs and may lead to the development of state-of-the-art active visual adaptation photosensors.

Negative Photoconductivity Transistors for Visuomorphic Computing

Visuomorphic computing aims to simulate and potentially surpass the human retina by mimicking biological visual perception with an artificial retina. Despite significant progress, challenges persist in perceiving complex interactive environments. Negative photoconductivity transistors (NPTs) mimic synaptic behavior by achieving adjustable positive photoconductivity (PPC) and negative photoconductivity (NPC), simulating "excitation" and "inhibition" akin to sensory cell signals. In complex interactive environments, NPTs are desired for visuomorphic computing that can achieve a better sense of information, lower power consumption, and reduce hardware complexity. In this review, it is started by introducing the development process of NPTs, while placing a strong emphasis on the device structures, working mechanisms, and key performance parameters. The common material systems employed in NPTs based on their functions are then summarized. Moreover, it is proceeded to summarize the noteworthy applications of NPTs in optoelectronic devices, including advanced multibit nonvolatile memory, optoelectronic logic gates, optical encryption, and visual perception. Finally, the challenges and prospects that lie ahead in the ongoing development of NPTs are addressed, offering valuable insights into their applications in optoelectronics and a comprehensive understanding of their significance.

Highly Stretchable and Oriented Wafer-Scale Semiconductor Films for Organic Phototransistor Arrays

Stretchable organic phototransistor arrays have potential applications in artificial visual systems due to their capacity to perceive ultraweak light across a broad spectrum. Ensuring uniform mechanical and electrical performance of individual devices within these arrays requires semiconductor films with large-area scale, well-defined orientation, and stretchability. However, the progress of stretchable phototransistors is primarily impeded by their limited electrical properties and photodetection capabilities. Herein, wafer-scale and well-oriented semiconductor films were successfully prepared using a solution shearing process. The electrical properties and photodetection capabilities were optimized by improving the polymer chain alignment. Furthermore, a stretchable 10 × 10 transistor array with high device uniformity was fabricated, demonstrating excellent mechanical robustness and photosensitive imaging ability. These arrays based on highly stretchable and well-oriented wafer-scale semiconductor films have great application potential in the field of electronic eye and artificial visual systems.

Bionic Scotopic Adaptation Transistors for Nighttime Low Illumination Imaging

Human vision excels in perceiving nighttime low illumination due to biological feedforward adaptation. Replicating this ability in biomimetic vision using solid-state devices has been highly sought after. However, emulating scotopic adaptation, entailing a confluence of efficient photoexcitation and dynamic carrier modulation, presents formidable challenges. Here, we demonstrate a low-power and bionic scotopic adaptation transistor by coupling a light-absorption layer and an electron-trapping layer at the bottom of the semiconducting channel, enabling simultaneous achievement of efficient generation of free photocarriers and adaptive carrier accumulation within a single device. This innovation empowers our transistor to exhibit sensitivity-potentiated characteristics after adaptation, detecting scotopic-level illumination (0.001 lx) with exceptional photosensitivity up to 103 at low voltages below 2 V. Moreover, we have successfully replicated diverse scotopic vision functions, encompassing time-dependent visual threshold enhancement, light intensity-dependent adaptation index, imaging contrast enhancement for nighttime low illumination imaging, opening an opportunity for artificial night vision.

Strain-insensitive viscoelastic perovskite film for intrinsically stretchable neuromorphic vision-adaptive transistors

Stretchable neuromorphic optoelectronics present tantalizing opportunities for intelligent vision applications that necessitate high spatial resolution and multimodal interaction. Existing neuromorphic devices are either stretchable but not reconcilable with multifunctionality, or discrete but with low-end neurological function and limited flexibility. Herein, we propose a defect-tunable viscoelastic perovskite film that is assembled into strain-insensitive quasi-continuous microsphere morphologies for intrinsically stretchable neuromorphic vision-adaptive transistors. The resulting device achieves trichromatic photoadaptation and a rapid adaptive speed (<150 s) beyond human eyes (3 ~ 30 min) even under 100% mechanical strain. When acted as an artificial synapse, the device can operate at an ultra-low energy consumption (15 aJ) (far below the human brain of 1 ~ 10 fJ) with a high paired-pulse facilitation index of 270% (one of the best figures of merit in stretchable synaptic phototransistors). Furthermore, adaptive optical imaging is achieved by the strain-insensitive perovskite films, accelerating the implementation of next-generation neuromorphic vision systems.

Biomimetic nanocluster photoreceptors for adaptative circular polarization vision

Nanoclusters with atomically precise structures and discrete energy levels are considered as nanoscale semiconductors for artificial intelligence. However, nanocluster electronic engineering and optoelectronic behavior have remained obscure and unexplored. Hence, we create nanocluster photoreceptors inspired by mantis shrimp visual systems to satisfy the needs of compact but multi-task vision hardware and explore the photo-induced electronic transport. Wafer-scale arrayed photoreceptors are constructed by a nanocluster-conjugated molecule heterostructure. Nanoclusters perform as an in-sensor charge reservoir to tune the conductance levels of artificial photoreceptors by a light valve mechanism. A ligand-assisted charge transfer process takes place at nanocluster interface and it features an integration of spectral-dependent visual adaptation and circular polarization recognition. This approach is further employed for developing concisely structured, multi-task, and compact artificial visual systems and provides valuable guidelines for nanocluster neuromorphic devices.

Recent Advances in Low-Dimensional Nanomaterials for Photodetectors

New emerging low-dimensional such as 0D, 1D, and 2D nanomaterials have attracted tremendous research interests in various fields of state-of-the-art electronics, optoelectronics, and photonic applications due to their unique structural features and associated electronic, mechanical, and optical properties as well as high-throughput fabrication for large-area and low-cost production and integration. Particularly, photodetectors which transform light to electrical signals are one of the key components in modern optical communication and developed imaging technologies for whole application spectrum in the daily lives, including X-rays and ultraviolet biomedical imaging, visible light camera, and infrared night vision and spectroscopy. Today, diverse photodetector technologies are growing in terms of functionality and performance beyond the conventional silicon semiconductor, and low-dimensional nanomaterials have been demonstrated as promising potential platforms. In this review, the current states of progress on the development of these nanomaterials and their applications in the field of photodetectors are summarized. From the elemental combination for material design and lattice structure to the essential investigations of hybrid device architectures, various devices and recent developments including wearable photodetectors and neuromorphic applications are fully introduced. Finally, the future perspectives and challenges of the low-dimensional nanomaterials based photodetectors are also discussed.

Bidirectional Invisible Photoresponse Implemented in a Traps Matrix-Combination toward Fully Optical Artificial Synapses

Fully optical artificial synapses are crucial hardware for neuromorphic computing, which is very promising to address the future large-scale computing capacity problem. The key characteristic required in a semiconductor device to emulate synaptic potentiation and depression in a fully optical artificial synapse is the bidirectional photoresponse. This work integrates wide-band-gap TiO2 polycrystals and narrow-band-gap PbS quantum dots into a graphene transistor simultaneously, providing the device with both near-ultraviolet and near-infrared photoresponses through the photogating effect. Moreover, the TiO2 serves as a hole-trapping matrix and the PbS as an electron-trapping matrix, which impose opposite effects to the device after photoexcitation, resulting in a photoresponse in the opposite polarity. As a result, the device demonstrates a wavelength-dependent bidirectional photoresponse, which enables it to be utilized as a fully optical artificial synapse. By using near-ultraviolet or near-infrared lights as stimuli, the device successfully mimics synaptic plasticity, including synaptic potentiation/depression, paired-pulse facilitation, and spike-rating-dependent plasticity, as well as the human brain-like transition of short-term memory and long-term memory and learning-experience behavior. This work validates the methodology of combining different trap matrices to achieve the bidirectional photoresponse, which can significantly inspire future research in fully optical artificial synapses.

Applications of Graphene in Five Senses, Nervous System, and Artificial Muscles

Graphene remains of great interest in biomedical applications because of biocompatibility. Diseases relating to human senses interfere with life satisfaction and happiness. Therefore, the restoration by artificial organs or sensory devices may bring a bright future by the recovery of senses in patients. In this review, we update the most recent progress in graphene based sensors for mimicking human senses such as artificial retina for image sensors, artificial eardrums, gas sensors, chemical sensors, and tactile sensors. The brain-like processors are discussed based on conventional transistors as well as memristor related neuromorphic computing. The brain-machine interface is introduced for providing a single pathway. Besides, the artificial muscles based on graphene are summarized in the means of actuators in order to react to the physical world. Future opportunities remain for elevating the performances of human-like sensors and their clinical applications.