A CMOS In-Pixel CTIA High Sensitivity Fluorescence Imager

High Precision Ping-Pong Auto-Zeroed Lock-in Fluorescence Photometry Sensor

This paper presents a high-precision CMOS fluorescence photometry sensor using a novel lock-in amplification scheme based on switched-biasing and ping-pong auto-zeroing techniques. The CMOS sensor includes two photodiodes and a lock-in amplifier (LIA) operating at 1 kHz. The LIA comprises a differential low-noise amplifier using a novel switched-biasing ping-pong auto-zeroed scheme, an automatic phase aligner, a programmable gain amplifier, a band-pass filter, a mixer, and an output low-pass filter. The design is fabricated in 0.18-µm CMOS process, and the measurement shows that the LIA can retrieve noisy input signals with a dynamic reserve of 42 dB, while consuming only 0.7 mW from a 1.8 V supply voltage. The measured results show that the LIA can detect a wide range of incident light power from 8 nW to 24 µW. The proposed design is encapsulated in a 3D-printed housing allowing for real-time in vitro biomarker detection. This ambulatory platform uses an LED and a fiber optic to convey the excitation light to the sample and retrieve the fluorescence signal. Experiments with a beads solution diluted in PBS demonstrate that the sensor has a sensitivity of 1:100 k. Experimental results obtained in vitro with NIH3T3 mouse cells tagged with membrane dye show the ability of the prototype to detect different densities of cell culture. The portable prototype, which includes optical filters and a small 30 mm × 36 mm × 30 mm printed circuit board enclosed inside the 3D-printed housing, consumes 36.7 mW and weighs 120 g.

A Highly Integrated Lab-on-a-CMOS Platform for Real-Time Monitoring of E. Coli Growth Kinetics

Existing miniaturized and cost-effective solutions for bacterial growth monitoring usually require offline incubators with constant temperature to culture the bio-samples prior to measurement. Such a separated sample preparation and detection scheme requires extensive human intervention, risks contamination, and suffers from poor temporal resolution. To achieve integrated sample preparation and real-time bacterial growth monitoring, this article presents a lab-on-a-CMOS platform incorporates an optical sensor array, temperature sensor array, micro-heaters, and readout circuits. Escherichia coli's (E. coli) optimum growth temperature of 37 °C is achieved through a heat regulation system consisting of two micro-heaters and an on-chip temperature sensor array. A photodiode array with an in-pixel capacitive trans-impedance amplifier to reduce inter-pixel cross-coupling is designed to extract the optical information during bacterial growth. To balance the footprint, power consumption, and quantization speed, a 10 b column successive-approximation register (SAR)/single-slope (SS) dual-mode analog-to-digital converter (ADC) is designed to digitize the temperature and optical signals. Fabricated in a standard 0.18 um CMOS process, the proposed platform can regulate the sample temperature to 37 +/- 0.2/0.3 °C within 32 mins. Enabled by an on-chip heat regulation system and photodetectors, the prototype demonstrates a real-time monitoring of bacterial growth kinetics and antibiotic responses. Minute-level temporal resolution is achieved as this proposed platform is free of extensive and time-consuming human intervention. The proposed platform can be viably used in contamination sensitive applications such as antibiotic tests, stem cell cultures, and organ-on-chips.

Motion-Based Object Location on a Smart Image Sensor Using On-Pixel Memory

Object location is a crucial computer vision method often used as a previous stage to object classification. Object-location algorithms require high computational and memory resources, which poses a difficult challenge for portable and low-power devices, even when the algorithm is implemented using dedicated digital hardware. Moving part of the computation to the imager may reduce the memory requirements of the digital post-processor and exploit the parallelism available in the algorithm. This paper presents the architecture of a Smart Imaging Sensor (SIS) that performs object location using pixel-level parallelism. The SIS is based on a custom smart pixel, capable of computing frame differences in the analog domain, and a digital coprocessor that performs morphological operations and connected components to determine the bounding boxes of the detected objects. The smart-pixel array implements on-pixel temporal difference computation using analog memories to detect motion between consecutive frames. Our SIS can operate in two modes: (1) as a conventional image sensor and (2) as a smart sensor which delivers a binary image that highlights the pixels in which movement is detected between consecutive frames and the object bounding boxes. In this paper, we present the design of the smart pixel and evaluate its performance using post-parasitic extraction on a 0.35 µm mixed-signal CMOS process. With a pixel-pitch of 32 µm × 32 µm, we achieved a fill factor of 28%. To evaluate the scalability of the design, we ported the layout to a 0.18 µm process, achieving a fill factor of 74%. On an array of 320×240 smart pixels, the circuit operates at a maximum frame rate of 3846 frames per second. The digital coprocessor was implemented and validated on a Xilinx Artix-7 XC7A35T field-programmable gate array that runs at 125 MHz, locates objects in a video frame in 0.614 µs, and has a power consumption of 58 mW.

Optics-Free Chip-Scale Intraoperative Imaging Using NIR-Excited Upconverting Nanoparticles

We present an optics-free CMOS image sensor that incorporates a novel time-gated dual-photodiode pixel design to allow filter- and lens-less image acquisition of near-infrared-excited (NIR-excited) upconverting nanoparticles. Recent biomedical advances have highlighted the benefits of NIR excitation, but NIR interaction with silicon has remained a challenge, even with high-performance optical blocking filters. Using a secondary diode and a dual-photodiode design, this sensor is able to remove the 100s of mV of NIR background on pixels and bring it down to single-digit mV level, nearing its noise floor of 2.2 mV rms, not achievable with any optical filter. Non-linear effects of background cancellation using the diode pair has been mitigated using an initial one-time pixel-level curve fitting and calibration in a post-processing setting. This imager comprises a highly linear 11 fF metal-oxide-metal (MOM) capacitor and includes integrated angle-selective gratings to reject oblique light and enhance sharpness. Each pixel also includes two distinct correlated double sampling schemes, to remove low frequency flicker noise and systematic offset in the datapath. We demonstrate the performance of this imager using pulsed NIR-excited upconverting nanoparticles on standard United-States-Air-Force (USAF) resolution targets and achieve an SNR of 15 dB, while keeping NIR background below 6 mV. This 36-by-80-pixel array measures only 2.3 mm by 4.8 mm and can be thinned down to 25 µm, allowing it to become surgically compatible with intraoperative instruments and equipment, while remaining optics-free.

An Ultra-High Frame Rate Ion Imaging Platform Using ISFET Arrays With Real-Time Compression

In this paper, a Lab-on-Chip platform with ultra-high throughput and real-time image compression for high speed ion imaging is presented. The sensing front-end comprises of a CMOS ISFET array with sensors biased in velocity saturation for a linear pH-to-current conversion and high spatial and temporal resolution. An array of 128 × 128 pixels is designed with a pixel size of 13.5 μm × 10.5 μm. In-pixel reset switches are applied for offset compensation, by asynchronously resetting the floating gate of the ISFET to a known fixed potential. Additionally, each row of pixels is processed by a current mode signal pipeline with auto zeroing functionality to remove fixed pattern noise, followed by an on-chip 1 MS/s 8-bit row-parallel single slope ADC. Fabricated in standard TSMC 180 nm BCD process, the entire system-on-chip occupies a silicon area of 2 mm × 2 mm, and achieves a frame rate of 6100 fps (7800 fps from simulation). A high speed 25 ms-latency readout platform based on a USB 3.0 interface and standard JPEG is presented for real-time ion imaging and image compression respectively, while an optimised JPEG algorithm is also designed and verified for a higher compression ratio without sacrificing image quality. We demonstrate real-time ion image visualisation by sensing high speed ion diffusion at 6100 fps, which is more than two times faster than the current state-of-the-art.

Face Recognition on a Smart Image Sensor Using Local Gradients

In this paper, we present the architecture of a smart imaging sensor (SIS) for face recognition, based on a custom-design smart pixel capable of computing local spatial gradients in the analog domain, and a digital coprocessor that performs image classification. The SIS uses spatial gradients to compute a lightweight version of local binary patterns (LBP), which we term ringed LBP (RLBP). Our face recognition method, which is based on Ahonen's algorithm, operates in three stages: (1) it extracts local image features using RLBP, (2) it computes a feature vector using RLBP histograms, (3) it projects the vector onto a subspace that maximizes class separation and classifies the image using a nearest neighbor criterion. We designed the smart pixel using the TSMC 0.35 μm mixed-signal CMOS process, and evaluated its performance using postlayout parasitic extraction. We also designed and implemented the digital coprocessor on a Xilinx XC7Z020 field-programmable gate array. The smart pixel achieves a fill factor of 34% on the 0.35 μm process and 76% on a 0.18 μm process with 32 μm × 32 μm pixels. The pixel array operates at up to 556 frames per second. The digital coprocessor achieves 96.5% classification accuracy on a database of infrared face images, can classify a 150×80-pixel image in 94 μs, and consumes 71 mW of power.

Monte Carlo Modeling of Shortwave-Infrared Fluorescence Photon Migration in Voxelized Media for the Detection of Breast Cancer

Recent progress regarding shortwave-infrared (SWIR) molecular imaging technology has inspired another modality of noninvasive diagnosis for early breast cancer detection in which previous mammography or sonography would be compensated. Although a SWIR fluorescence image of a small breast cancer of several millimeters was obtained from experiments with small animals, detailed numerical analyses before clinical application were required, since various parameters such as size as well as body hair differed between humans and small experimental animals. In this study, the feasibility of SWIR was compared against visible (VIS) and near-infrared (NIR) region, using the Monte Carlo simulation in voxelized media. In this model, due to the implementation of the excitation gradient, fluorescence is based on rational mechanisms, whereas fluorescence within breast cancer is spatially proportional to excitation intensity. The fluence map of SWIR simulation with excitation gradient indicated signals near the upper surface of the cancer, and stronger than those of the NIR. Furthermore, there was a dependency on the fluence signal distribution on the contour of the breast tissue, as well as the internal structure, due to the implementation of digital anatomical data for the Visible Human Project. The fluorescence signal was observed to become weaker in all regions including the VIS, the NIR, and the SWIR region, when fluorescence-labeled cancer either became smaller or was embedded in a deeper area. However, fluorescence in SWIR alone from a cancer of 4 mm diameter was judged to be detectable at a depth of 1.4 cm.

Analysis and Design of a CMOS Ultra-High-Speed Burst Mode Imager with In-Situ Storage Topology Featuring In-Pixel CDS Amplification

This paper presents an in-situ storage topology for ultra-high-speed burst mode imagers, enabling low noise operation while keeping a high frame depth. The proposed pixel architecture contains a 4T pinned photodiode, a correlated double sampling (CDS) amplification stage, and an in-situ memory bank. Focusing on the sampling noise, the system level trade-off of the proposed pixel architecture is discussed, showing its advantages on the noise, power, and scaling capability. Integrated with an AC coupling CDS stage, the amplification is obtained by exploiting the strong capacitance to the voltage relation of a single NMOS transistor. A comprehensive noise model is developed for optimizing the trade-off between the area and noise. As a proof-of-concept, a prototype imager with a 30 µm pixel pitch was fabricated in a CMOS 130 nm technology. A 108-cell memory bank is implemented allowing dense layout and parallel readout. Two types of CDS amplification stages were investigated. Despite the limited memory capacitance of 10 fF/cell, the photon transfer curves of both pixel types were measured over different operation speeds up to 20 Mfps showing a noise performance of 8.4 e⁻.

A CMOS Luminescence Intensity and Lifetime Dual Sensor Based on Multicycle Charge Modulation

Luminescence plays an important role in many scientific and industrial applications. This paper proposes a novel complementary metal-oxide-semiconductor (CMOS) sensor chip that can realize both luminescence intensity and lifetime sensing. To enable high sensitivity, we propose parasitic insensitive multicycle charge modulation scheme for low-light lifetime extraction benefiting from simplicity, accuracy, and compatibility with deeply scaled CMOS process. The designed in-pixel capacitive transimpedance amplifier (CTIA) based structure is able to capture the weak luminescence-induced voltage signal by accumulating photon-generated charges in 25 discrete gated 10-ms time windows and 10-μs pulsewidth. A pinned photodiode on chip with 1.04 pA dark current is utilized for luminescence detection. The proposed CTIA-based circuitry can achieve 2.1-mV/(nW/cm²) responsivity and 4.38-nW/cm² resolution at 630 nm wavelength for intensity measurement and 45-ns resolution for lifetime measurement. The sensor chip is employed for measuring time constants and luminescence lifetimes of an InGaN-based white light-emitting diode at different wavelengths. In addition, we demonstrate accurate measurement of the lifetime of an oxygen sensitive chromophore with sensitivity to oxygen concentration of 7.5%/ppm and 6%/ppm in both intensity and lifetime domain. This CMOS-enabled oxygen sensor was then employed to test water quality from different sources (tap water, lakes, and rivers).

A Wireless Fiber Photometry System Based on a High-Precision CMOS Biosensor With Embedded Continuous-Time Modulation

Fluorescence biophotometry measurements require wide dynamic range (DR) and high-sensitivity laboratory apparatus. Indeed, it is often very challenging to accurately resolve the small fluorescence variations in presence of noise and high-background tissue autofluorescence. There is a great need for smaller detectors combining high linearity, high sensitivity, and high-energy efficiency. This paper presents a new biophotometry sensor merging two individual building blocks, namely a low-noise sensing front-end and a order continuous-time modulator (CTSDM), into a single module for enabling high-sensitivity and high energy-efficiency photo-sensing. In particular, a differential CMOS photodetector associated with a differential capacitive transimpedance amplifier-based sensing front-end is merged with an incremental order 1-bit CTSDM to achieve a large DR, low hardware complexity, and high-energy efficiency. The sensor leverages a hardware sharing strategy to simplify the implementation and reduce power consumption. The proposed CMOS biosensor is integrated within a miniature wireless head mountable prototype for enabling biophotometry with a single implantable fiber in the brain of live mice. The proposed biophotometry sensor is implemented in a 0.18- CMOS technology, consuming from a 1.8- supply voltage, while achieving a peak dynamic range of over a 50- input bandwidth, a sensitivity of 24 mV/nW, and a minimum detectable current of 2.46- at a 20- sampling rate.

CMOS Image Sensor and System for Imaging Hemodynamic Changes in Response to Deep Brain Stimulation

Deep brain stimulation (DBS) is a therapeutic intervention used for a variety of neurological and psychiatric disorders, but its mechanism of action is not well understood. It is known that DBS modulates neural activity which changes metabolic demands and thus the cerebral circulation state. However, it is unclear whether there are correlations between electrophysiological, hemodynamic and behavioral changes and whether they have any implications for clinical benefits. In order to investigate these questions, we present a miniaturized system for spectroscopic imaging of brain hemodynamics. The system consists of a 144 ×144, [Formula: see text] pixel pitch, high-sensitivity, analog-output CMOS imager fabricated in a standard 0.35 μm CMOS process, along with a miniaturized imaging system comprising illumination, focusing, analog-to-digital conversion and μSD card based data storage. This enables stand alone operation without a computer, nor electrical or fiberoptic tethers. To achieve high sensitivity, the pixel uses a capacitive transimpedance amplifier (CTIA). The nMOS transistors are in the pixel while pMOS transistors are column-parallel, resulting in a fill factor (FF) of 26%. Running at 60 fps and exposed to 470 nm light, the CMOS imager has a minimum detectable intensity of 2.3 nW/cm(2) , a maximum signal-to-noise ratio (SNR) of 49 dB at 2.45 μW/cm(2) leading to a dynamic range (DR) of 61 dB while consuming 167 μA from a 3.3 V supply. In anesthetized rats, the system was able to detect temporal, spatial and spectral hemodynamic changes in response to DBS.

Wireless fluorescence capsule for endoscopy using single photon-based detection

Fluorescence Imaging (FI) is a powerful technique in biological science and clinical medicine. Current FI devices that are used either for in-vivo or in-vitro studies are expensive, bulky and consume substantial power, confining the technique to laboratories and hospital examination rooms. Here we present a miniaturised wireless fluorescence endoscope capsule with low power consumption that will pave the way for future FI systems and applications. With enhanced sensitivity compared to existing technology we have demonstrated that the capsule can be successfully used to image tissue autofluorescence and targeted fluorescence via fluorophore labelling of tissues. The capsule incorporates a state-of-the-art complementary metal oxide semiconductor single photon avalanche detector imaging array, miniaturised optical isolation, wireless technology and low power design. When in use the capsule consumes only 30.9 mW, and deploys very low-level 468 nm illumination. The device has the potential to replace highly power-hungry intrusive optical fibre based endoscopes and to extend the range of clinical examination below the duodenum. To demonstrate the performance of our capsule, we imaged fluorescence phantoms incorporating principal tissue fluorophores (flavins) and absorbers (haemoglobin). We also demonstrated the utility of marker identification by imaging a 20 μM fluorescein isothiocyanate (FITC) labelling solution on mammalian tissue.

A Dynamic Range Enhanced Readout Technique with a Two-Step TDC for High Speed Linear CMOS Image Sensors

This paper presents a dynamic range (DR) enhanced readout technique with a two-step time-to-digital converter (TDC) for high speed linear CMOS image sensors. A multi-capacitor and self-regulated capacitive trans-impedance amplifier (CTIA) structure is employed to extend the dynamic range. The gain of the CTIA is auto adjusted by switching different capacitors to the integration node asynchronously according to the output voltage. A column-parallel ADC based on a two-step TDC is utilized to improve the conversion rate. The conversion is divided into coarse phase and fine phase. An error calibration scheme is also proposed to correct quantization errors caused by propagation delay skew within −T_clk~+T_clk. A linear CMOS image sensor pixel array is designed in the 0.13 μm CMOS process to verify this DR-enhanced high speed readout technique. The post simulation results indicate that the dynamic range of readout circuit is 99.02 dB and the ADC achieves 60.22 dB SNDR and 9.71 bit ENOB at a conversion rate of 2 MS/s after calibration, with 14.04 dB and 2.4 bit improvement, compared with SNDR and ENOB of that without calibration.

CMOS time-resolved, contact, and multispectral fluorescence imaging for DNA molecular diagnostics

Instrumental limitations such as bulkiness and high cost prevent the fluorescence technique from becoming ubiquitous for point-of-care deoxyribonucleic acid (DNA) detection and other in-field molecular diagnostics applications. The complimentary metal-oxide-semiconductor (CMOS) technology, as benefited from process scaling, provides several advanced capabilities such as high integration density, high-resolution signal processing, and low power consumption, enabling sensitive, integrated, and low-cost fluorescence analytical platforms. In this paper, CMOS time-resolved, contact, and multispectral imaging are reviewed. Recently reported CMOS fluorescence analysis microsystem prototypes are surveyed to highlight the present state of the art.

Noise limits of CMOS current interfaces for biosensors: a review

Current sensing readout is one of the most frequent techniques used in biosensing due to the charge-transfer phenomena occurring at solid-liquid interfaces. The development of novel nanodevices for biosensing determines new challenges for electronic interface design based on current sensing, especially when compact and efficient arrays need to be organized, such as in recent trends of rapid label-free electronic detection of DNA synthesis. This paper will review the basic noise limitations of current sensing interfaces with particular emphasis on integrated CMOS technology. Starting from the basic theory, the paper presents, investigates and compares charge-sensitive amplifier architectures used in both continuous-time and discrete-time approaches, along with their design trade-offs involving noise floor, sensitivity to stray capacitance and bandwidth. The ultimate goal of this review is providing analog designers with helpful design rules and analytical tools. Also, in order to present a comprehensive overview of the state-of-the-art, the most relevant papers recently appeared in the literature about this topic are discussed and compared.

CMOS tunable-wavelength multi-color photogate sensor

A CMOS tunable-wavelength multi-color photogate (CPG) sensor is presented. Sensing of a small set of well-separated wavelengths (e.g., > 50 nm apart) is achieved by tuning the spectral response of the device with a bias voltage. The CPG employs the polysilicon gate as an optical filter, which eliminates the need for an external color filter. A prototype has been fabricated in a standard 0.35 μm digital CMOS technology and demonstrates intensity measurements of blue (450 nm), green (520 nm), and red (620 nm) illumination with peak signal-to-noise ratios (SNRs) of 34.7 dB , 29.2 dB, and 34.8 dB, respectively. The prototype is applied to fluorescence detection of green-emitting quantum dots (gQDs) and red-emitting quantum dots (rQDs). It spectrally differentiates among multiple emission bands, effectively implementing on-chip emission filtering. The prototype demonstrates single-color measurements of gQD and rQD concentrations to a detection limit of 24 nM, and multi-color measurements of solutions containing both colors of QDs to a detection limit of 90 nM and 120 nM of gQD and rQD, respectively.

CMOS spectrally-multiplexed FRET-on-a-chip for DNA analysis

A spectral-multiplexed fluorescence contact imaging microsystem for DNA analysis is presented. The microsystem integrates a filterless CMOS Color PhotoGate (CPG) sensor that exploits the polysilicon gate as an optical filter, and therefore does not require an external color filter. The CPG is applied to fluorescence-based transduction in a spectrally multiplexed format by differentiating among multiple emission bands, hence replacing the functionality of a bank of emission filters. A microsystem has been quantitatively modeled and prototyped based on the CPG fabricated in a standard 0.35 μm CMOS technology. The multi-color imaging capability of the microsystem in analyzing DNA targets has been validated in the detection of marker gene sequences for spinal muscular atropy disease and Escherichia coli (E. coli). Spectral-multiplexing enables the two DNA targets to be simultaneously detected with a measured detection limits of 240 nM and 210 nM for the two target concentrations at a sample volume of 10 μL for the green and red transduction channels, respectively.

Design constraints for mobile, high-speed fluorescence brain imaging in awake animals

In this paper we present a fully self-contained imaging instrument (30 mm overall length) that is capable of recording high speed and detect relatively small fluorescent signals (0.1% ΔF/F) from brain tissues potentially containing genetically-encoded sensors or dyes. This device potentially enables the study of neuronal activity in awake and mobile animals during natural behaviors without the stress and suppression of anesthesia and restraint. The device is a fully self-contained illumination system, wide field fluorescence microscope (~ 4.8 mm² FOV-25 um lateral resolution-1.8 × magnification-0.39 NA) and CMOS image sensor (32 × 32). The total weight of the system is 10 g and is capable of imaging up to 900 fps. We present voltage dye RH1692 experiments using the system to study the somatosensory cortex of mice during whisker movements using an air puff.

A miniaturized platform for laser speckle contrast imaging

Imaging the brain in animal models enables scientists to unravel new biological insights. Despite critical advancements in recent years, most laboratory imaging techniques comprise of bulky bench top apparatus that require the imaged animals to be anesthetized and immobilized. Thus, animals are imaged in their non-native state severely restricting the scope of behavioral experiments. To address this gap, we report a miniaturized microscope that can be mounted on a rat's head for imaging in awake and unrestrained conditions. The microscope uses laser speckle contrast imaging (LSCI), a high resolution yet wide field imaging modality for imaging blood vessels and perfusion. Design details of both the image formation and acquisition modules are presented. A Monte Carlo simulation was used to estimate the depth of tissue penetration achievable by the imaging system while the produced speckle Airy disc patterns were simulated using Fresnel's diffraction theory. The microscope system weighs only 7 g and occupies less than 5 cm³ and was successfully used to generate proof of concept LSCI images of rat brain vasculature. We validated the utility of the head-mountable system in an awake rat brain model by confirming no impairment to the rat's native behavior.