A Low-Light CMOS Contact Imager With an Emission Filter for Biosensing Applications

Miniaturized High-Throughput and High-Resolution Platform for Continuous Live-Cell Monitoring via Lens-Free Imaging and Deep Learning

Monitoring the morphology and dynamics of both individual and collective cells is crucial for understanding the complexities of biological systems, investigating disease mechanisms, and advancing therapeutic strategies. However, traditional live-cell workstations that rely on microscopy often face inherent trade-offs between field of view (FOV) and resolution, making it difficult to achieve both high-throughput and high-resolution monitoring simultaneously. While existing lens-free imaging technologies enable high-throughput cell monitoring, they are often hindered by algorithmic complexity, long processing times that prevent real-time imaging, or insufficient resolution due to large sensor pixel sizes. To overcome these limitations, here an imaging platform is presented that integrates a custom-developed 500 nm pixel-size, 400-megapixel sensor with lens-free shadow imaging technology. This platform is capable of achieving imaging at a speed of up to 40s per frame, with a large FOV of 1 cm2 and an imaging signal-to-noise ratio (SNR) of 42 dB, enabling continuous tracking of individual and cell populations throughout their entire lifecycle. By leveraging deep learning algorithms, the system accurately analyzes cell movement trajectories, while the integration of a K-means unsupervised clustering algorithm ensures precise evaluation of cellular activity. This platform provides an effective solution for high-throughput live-cell morphology monitoring and dynamic analysis.

Thin and Scalable Hybrid Emission Filter via Plasma Etching for Low-Invasive Fluorescence Detection

Hybrid emission filters, comprising an interference filter and an absorption filter, exhibit high excitation light rejection performance and can act as lensless fluorescent devices. However, it has been challenging to produce them in large batches over a large area. In this study, we propose and demonstrate a method for transferring a Si substrate, on which the hybrid filter is deposited, onto an image sensor by attaching it to the sensor and removing the substrate via plasma etching. Through this method, we can transfer uniform filters onto fine micrometer-sized needle devices and millimeter-sized multisensor chips. Optical evaluation reveals that the hybrid filter emits light in the 500 to 560 nm range, close to the emission region of green fluorescent protein (GFP). Furthermore, by observing the fluorescence emission from the microbeads, a spatial resolution of 12.11 μm is calculated. In vitro experiments confirm that the fabricated device is able to discriminate GFP emission patterns from brain slices.

Highly sensitive lens-free fluorescence imaging device enabled by a complementary combination of interference and absorption filters

We report a lens-free fluorescence imaging device using a composite filter composed of an interference filter and an absorption filter, each applied to one side of a fiber optic plate (FOP). The transmission of angled excitation light through the interference filter is absorbed by the absorption filter. The auto-fluorescence of the absorption filter is reduced by the reflection from the interference filter of normally incident excitation light. As a result, high-performance rejection of excitation light is achieved in a lens-free device. The FOP provides a flat, hard imaging device surface that does not degrade the spatial resolution. We demonstrate excitation rejection of approximately 108:1 at a wavelength of 450 nm in a fabricated lens-free device. The resolution of fluorescence imaging is approximately 12 µm. Time-lapse imaging of cells containing green fluorescent protein was performed in a 5-µm thin-film chamber. The small dimensions of the device allow observation of cell culturing in a CO2 incubator. We also demonstrate that the proposed lens-free filter is compatible with super-resolution bright-field imaging techniques. These features open a way to develop a high-performance, dual-mode, lens-free imaging device that is expected to be a powerful tool for many applications, such as imaging of labeled cells and point-of-care assay.

Challenges in paper-based fluorogenic optical sensing with smartphones

Application of optically superior, tunable fluorescent nanotechnologies have long been demonstrated throughout many chemical and biological sensing applications. Combined with microfluidics technologies, i.e. on lab-on-a-chip platforms, such fluorescent nanotechnologies have often enabled extreme sensitivity, sometimes down to single molecule level. Within recent years there has been a peak interest in translating fluorescent nanotechnology onto paper-based platforms for chemical and biological sensing, as a simple, low-cost, disposable alternative to conventional silicone-based microfluidic substrates. On the other hand, smartphone integration as an optical detection system as well as user interface and data processing component has been widely attempted, serving as a gateway to on-board quantitative processing, enhanced mobility, and interconnectivity with informational networks. Smartphone sensing can be integrated to these paper-based fluorogenic assays towards demonstrating extreme sensitivity as well as ease-of-use and low-cost. However, with these emerging technologies there are always technical limitations that must be addressed; for example, paper's autofluorescence that perturbs fluorogenic sensing; smartphone flash's limitations in fluorescent excitation; smartphone camera's limitations in detecting narrow-band fluorescent emission, etc. In this review, physical optical setups, digital enhancement algorithms, and various fluorescent measurement techniques are discussed and pinpointed as areas of opportunities to further improve paper-based fluorogenic optical sensing with smartphones.

A Microfluidic Cytometer for Complete Blood Count With a 3.2-Megapixel, 1.1- μm-Pitch Super-Resolution Image Sensor in 65-nm BSI CMOS

Based on a 3.2-Megapixel 1.1- μm-pitch super-resolution (SR) CMOS image sensor in a 65-nm backside-illumination process, a lens-free microfluidic cytometer for complete blood count (CBC) is demonstrated in this paper. Backside-illumination improves resolution and contrast at the device level with elimination of surface treatment when integrated with microfluidic channels. A single-frame machine-learning-based SR processing is further realized at system level for resolution correction with minimum hardware resources. The demonstrated microfluidic cytometer can detect the platelet cells (< 2 μm) required in CBC, hence is promising for point-of-care diagnostics.

System-on-Chip Considerations for Heterogeneous Integration of CMOS and Fluidic Bio-Interfaces

CMOS chips are increasingly used for direct sensing and interfacing with fluidic and biological systems. While many biosensing systems have successfully combined CMOS chips for readout and signal processing with passive sensing arrays, systems that co-locate sensing with active circuits on a single chip offer significant advantages in size and performance but increase the complexity of multi-domain design and heterogeneous integration. This emerging class of lab-on-CMOS systems also poses distinct and vexing technical challenges that arise from the disparate requirements of biosensors and integrated circuits (ICs). Modeling these systems must address not only circuit design, but also the behavior of biological components on the surface of the IC and any physical structures. Existing tools do not support the cross-domain simulation of heterogeneous lab-on-CMOS systems, so we recommend a two-step modeling approach: using circuit simulation to inform physics-based simulation, and vice versa. We review the primary lab-on-CMOS implementation challenges and discuss practical approaches to overcome them. Issues include new versions of classical challenges in system-on-chip integration, such as thermal effects, floor-planning, and signal coupling, as well as new challenges that are specifically attributable to biological and fluidic domains, such as electrochemical effects, non-standard packaging, surface treatments, sterilization, microfabrication of surface structures, and microfluidic integration. We describe these concerns as they arise in lab-on-CMOS systems and discuss solutions that have been experimentally demonstrated.

Real-time bacterial microcolony counting using on-chip microscopy

Observing microbial colonies is the standard method for determining the microbe titer and investigating the behaviors of microbes. Here, we report an automated, real-time bacterial microcolony-counting system implemented on a wide field-of-view (FOV), on-chip microscopy platform, termed ePetri. Using sub-pixel sweeping microscopy (SPSM) with a super-resolution algorithm, this system offers the ability to dynamically track individual bacterial microcolonies over a wide FOV of 5.7 mm × 4.3 mm without requiring a moving stage or lens. As a demonstration, we obtained high-resolution time-series images of S. epidermidis at 20-min intervals. We implemented an image-processing algorithm to analyze the spatiotemporal distribution of microcolonies, the development of which could be observed from a single bacterial cell. Test bacterial colonies with a minimum diameter of 20 μm could be enumerated within 6 h. We showed that our approach not only provides results that are comparable to conventional colony-counting assays but also can be used to monitor the dynamics of colony formation and growth. This microcolony-counting system using on-chip microscopy represents a new platform that substantially reduces the detection time for bacterial colony counting. It uses chip-scale image acquisition and is a simple and compact solution for the automation of colony-counting assays and microbe behavior analysis with applications in antibacterial drug discovery.

Real-time, continuous, fluorescence sensing in a freely-moving subject with an implanted hybrid VCSEL/CMOS biosensor

Performance improvements in instrumentation for optical imaging have contributed greatly to molecular imaging in living subjects. In order to advance molecular imaging in freely moving, untethered subjects, we designed a miniature vertical-cavity surface-emitting laser (VCSEL)-based biosensor measuring 1cm(3) and weighing 0.7g that accurately detects both fluorophore and tumor-targeted molecular probes in small animals. We integrated a critical enabling component, a complementary metal-oxide semiconductor (CMOS) read-out integrated circuit, which digitized the fluorescence signal to achieve autofluorescence-limited sensitivity. After surgical implantation of the lightweight sensor for two weeks, we obtained continuous and dynamic fluorophore measurements while the subject was un-anesthetized and mobile. The technology demonstrated here represents a critical step in the path toward untethered optical sensing using an integrated optoelectronic implant.

Continuous sensing of tumor-targeted molecular probes with a vertical cavity surface emitting laser-based biosensor

Molecular optical imaging is a widespread technique for interrogating molecular events in living subjects. However, current approaches preclude long-term, continuous measurements in awake, mobile subjects, a strategy crucial in several medical conditions. Consequently, we designed a novel, lightweight miniature biosensor for in vivo continuous optical sensing. The biosensor contains an enclosed vertical-cavity surface-emitting semiconductor laser and an adjacent pair of near-infrared optically filtered detectors. We employed two sensors (dual sensing) to simultaneously interrogate normal and diseased tumor sites. Having established the sensors are precise with phantom and in vivo studies, we performed dual, continuous sensing in tumor (human glioblastoma cells) bearing mice using the targeted molecular probe cRGD-Cy5.5, which targets αVβ3 cell surface integrins in both tumor neovasculature and tumor. The sensors capture the dynamic time-activity curve of the targeted molecular probe. The average tumor to background ratio after signal calibration for cRGD-Cy5.5 injection is approximately 2.43±0.95 at 1 h and 3.64±1.38 at 2 h (N=5 mice), consistent with data obtained with a cooled charge coupled device camera. We conclude that our novel, portable, precise biosensor can be used to evaluate both kinetics and steady state levels of molecular probes in various disease applications.

Design constraints for mobile, high-speed fluorescence brain imaging in awake animals

In this paper we present a fully self-contained imaging instrument (30 mm overall length) that is capable of recording high speed and detect relatively small fluorescent signals (0.1% ΔF/F) from brain tissues potentially containing genetically-encoded sensors or dyes. This device potentially enables the study of neuronal activity in awake and mobile animals during natural behaviors without the stress and suppression of anesthesia and restraint. The device is a fully self-contained illumination system, wide field fluorescence microscope (~ 4.8 mm² FOV-25 um lateral resolution-1.8 × magnification-0.39 NA) and CMOS image sensor (32 × 32). The total weight of the system is 10 g and is capable of imaging up to 900 fps. We present voltage dye RH1692 experiments using the system to study the somatosensory cortex of mice during whisker movements using an air puff.

A CMOS In-Pixel CTIA High Sensitivity Fluorescence Imager

Traditionally, charge coupled device (CCD) based image sensors have held sway over the field of biomedical imaging. Complementary metal oxide semiconductor (CMOS) based imagers so far lack sensitivity leading to poor low-light imaging. Certain applications including our work on animal-mountable systems for imaging in awake and unrestrained rodents require the high sensitivity and image quality of CCDs and the low power consumption, flexibility and compactness of CMOS imagers. We present a 132×124 high sensitivity imager array with a 20.1 μm pixel pitch fabricated in a standard 0.5 μ CMOS process. The chip incorporates n-well/p-sub photodiodes, capacitive transimpedance amplifier (CTIA) based in-pixel amplification, pixel scanners and delta differencing circuits. The 5-transistor all-nMOS pixel interfaces with peripheral pMOS transistors for column-parallel CTIA. At 70 fps, the array has a minimum detectable signal of 4 nW/cm(2) at a wavelength of 450 nm while consuming 718 μA from a 3.3 V supply. Peak signal to noise ratio (SNR) was 44 dB at an incident intensity of 1 μW/cm(2). Implementing 4×4 binning allowed the frame rate to be increased to 675 fps. Alternately, sensitivity could be increased to detect about 0.8 nW/cm(2) while maintaining 70 fps. The chip was used to image single cell fluorescence at 28 fps with an average SNR of 32 dB. For comparison, a cooled CCD camera imaged the same cell at 20 fps with an average SNR of 33.2 dB under the same illumination while consuming over a watt.

Implantable semiconductor biosensor for continuous in vivo sensing of far-red fluorescent molecules

We have fabricated miniature implantable fluorescence sensors for continuous fluorescence sensing applications in living subjects. These monolithically integrated GaAs-based sensors incorporate a 675 nm vertical-cavity surface-emitting laser (VCSEL), a GaAs PIN photodiode, and a fluorescence emission filter. We demonstrate high detection sensitivity for Cy5.5 far-red dye (50 nanoMolar) in living tissue, limited by the intrinsic background autofluorescence. These low cost, sensitive and scalable sensors are promising for long-term continuous monitoring of molecular dynamics for biomedical studies in freely moving animals.

Low light CMOS contact imager with an integrated poly-acrylic emission filter for fluorescence detection

This study presents the fabrication of a low cost poly-acrylic acid (PAA) based emission filter integrated with a low light CMOS contact imager for fluorescence detection. The process involves the use of PAA as an adhesive for the emission filter. The poly-acrylic solution was chosen due its optical transparent properties, adhesive properties, miscibility with polar protic solvents and most importantly its bio-compatibility with a biological environment. The emission filter, also known as an absorption filter, involves dissolving an absorbing specimen in a polar protic solvent and mixing it with the PAA to uniformly bond the absorbing specimen and harden the filter. The PAA is optically transparent in solid form and therefore does not contribute to the absorbance of light in the visible spectrum. Many combinations of absorbing specimen and polar protic solvents can be derived, yielding different filter characteristics in different parts of the spectrum. We report a specific combination as a first example of implementation of our technology. The filter reported has excitation in the green spectrum and emission in the red spectrum, utilizing the increased quantum efficiency of the photo sensitive sensor array. The thickness of the filter (20 μm) was chosen by calculating the desired SNR using Beer-Lambert’s law for liquids, Quantum Yield of the fluorophore and the Quantum Efficiency of the sensor array. The filters promising characteristics make it suitable for low light fluorescence detection. The filter was integrated with a fully functional low noise, low light CMOS contact imager and experimental results using fluorescence polystyrene micro-spheres are presented.