On the importance of image formation optics in the design of infrared spectroscopic imaging systems

The Use of Constituent Spectra and Weighting in Extended Multiplicative Signal Correction in Infrared Spectroscopy

Extended multiplicative signal correction (EMSC) is a widely used preprocessing technique in infrared spectroscopy. EMSC is a model-based method favored for its flexibility and versatility. The model can be extended by adding constituent spectra to explicitly model-known analytes or interferents. This paper addresses the use of constituent spectra and demonstrates common pitfalls. It clarifies the difference between analyte and interferent spectra, and the importance of orthogonality between model spectra. Different normalization approaches are discussed, and the importance of weighting in the EMSC is demonstrated. The paper illustrates how constituent analyte spectra can be estimated, and how they can be used to extract additional information from spectral features. It is shown that the EMSC parameters can be used in both regression tasks and segmentation tasks.

Background-Suppressed High-Throughput Mid-Infrared Photothermal Microscopy via Pupil Engineering

Mid-infrared photothermal (MIP) microscopy has been a promising label-free chemical imaging technique for functional characterization of specimens owing to its enhanced spatial resolution and high specificity. Recently developed wide-field MIP imaging modalities have drastically improved speed and enabled high-throughput imaging of micron-scale subjects. However, the weakly scattered signal from subwavelength particles becomes indistinguishable from the shot-noise as a consequence of the strong background light, leading to limited sensitivity. Here, we demonstrate background-suppressed chemical fingerprinting at a single nanoparticle level by selectively attenuating the reflected light through pupil engineering in the collection path. Our technique provides over 3 orders of magnitude background suppression by quasi-darkfield illumination in the epi-configuration without sacrificing lateral resolution. We demonstrate 6-fold signal-to-background noise ratio improvement, allowing for simultaneous detection and discrimination of hundreds of nanoparticles across a field of view of 70 μm × 70 μm. A comprehensive theoretical framework for photothermal image formation is provided and experimentally validated with 300 and 500 nm PMMA beads. The versatility and utility of our technique are demonstrated via hyperspectral dark-field MIP imaging of S. aureus and E. coli bacteria and MIP imaging of subcellular lipid droplets inside C. albicans and cancer cells.

Design Considerations for Discrete Frequency Infrared Microscopy Systems

Discrete frequency infrared chemical imaging is transforming the practice of microspectroscopy by enabling a diversity of instrumentation and new measurement capabilities. While a variety of hardware implementations have been realized, design considerations that are unique to infrared (IR) microscopes have not yet been compiled in literature. Here, we describe the evolution of IR microscopes, provide rationales for design choices, and catalog some major considerations for each of the optical components in an imaging system. We analyze design choices that use these components to optimize performance, under their particular constraints, while providing illustrative examples. We then summarize a framework to assess the factors that determine an instrument's performance mathematically. Finally, we provide a validation approach by enumerating performance metrics that can be used to evaluate the capabilities of imaging systems or suitability for specific intended applications. Together, the presented concepts and examples should aid in understanding available instrument configurations, while guiding innovations in design of the next generation of IR chemical imaging spectrometers.

The effect of deformation of absorbing scatterers on Mie-type signatures in infrared microspectroscopy

Mie-type scattering features such as ripples (i.e., sharp shape-resonance peaks) and wiggles (i.e., broad oscillations), are frequently-observed scattering phenomena in infrared microspectroscopy of cells and tissues. They appear in general when the wavelength of electromagnetic radiation is of the same order as the size of the scatterer. By use of approximations to the Mie solutions for spheres, iterative algorithms have been developed to retrieve pure absorbance spectra. However, the question remains to what extent the Mie solutions, and approximations thereof, describe the extinction efficiency in practical situations where the shapes of scatterers deviate considerably from spheres. The aim of the current study is to investigate how deviations from a spherical scatterer can change the extinction properties of the scatterer in the context of chaos in wave systems. For this purpose, we investigate a chaotic scatterer and compare it with an elliptically shaped scatterer, which exhibits only regular scattering. We find that chaotic scattering has an accelerating effect on the disappearance of Mie ripples. We further show that the presence of absorption and the high numerical aperture of infrared microscopes does not explain the absence of ripples in most measurements of biological samples.

Analysis of Fixed and Live Single Cells Using Optical Photothermal Infrared with Concomitant Raman Spectroscopy

This paper reports the first use of a novel completely optically based photothermal method (O-PTIR) for obtaining infrared spectra of both fixed and living cells using a quantum cascade laser (QCL) and optical parametric oscillator (OPO) laser as excitation sources, thus enabling all biologically relevant vibrations to be analyzed at submicron spatial resolution. In addition, infrared data acquisition is combined with concomitant Raman spectra from exactly the same excitation location, meaning the full vibrational profile of the cell can be obtained. The pancreatic cancer cell line MIA PaCa-2 and the breast cancer cell line MDA-MB-231 are used as model cells to demonstrate the capabilities of the new instrumentation. These combined modalities can be used to analyze subcellular structures in both fixed and, more importantly, live cells under aqueous conditions. We show that the protein secondary structure and lipid-rich bodies can be identified on the submicron scale.

Concurrent Vibrational Circular Dichroism Measurements with Infrared Spectroscopic Imaging

Vibrational circular dichroism (VCD) spectroscopy has emerged as a powerful platform to quantify chirality, a vital biological property that performs a pivotal role in the metabolism of life organisms. With a photoelastic modulator (PEM) integrated into an infrared spectrometer, the differential response of a sample to the direction of circularly polarized light can be used to infer conformation handedness. However, these optical components inherently exhibit chromatic behavior and are typically optimized at discrete spectral frequencies. Advancements of discrete frequency infrared (DFIR) spectroscopic microscopes in spectral image quality and data throughput are promising for use toward analytical VCD measurements. Utilizing the PEM advantages incorporated into a custom-built QCL microscope, we demonstrate a point scanning VCD instrument capable of acquiring spectra rapidly across all fingerprint region wavelengths in transmission configuration. Moreover, for the first time, we also demonstrate the VCD imaging performance of our instrument for site-specific chirality mapping of biological tissue samples. This study offers some insight into future possibilities of examining small, localized changes in tissue that have major implications for systemic diseases and their progression, while also laying the groundwork for additional modeling and validation in advancing the capability of VCD spectroscopy and imaging.

All-digital histopathology by infrared-optical hybrid microscopy

Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.

Multicolor Discrete Frequency Infrared Spectroscopic Imaging

Advancement of discrete frequency infrared (DFIR) spectroscopic microscopes in image quality and data throughput are critical to their use for analytical measurements. Here, we report the development and characterization of a point scanning instrument with minimal aberrations and capable of diffraction-limited performance across all fingerprint region wavelengths over arbitrarily large samples. The performance of this system is compared to commercial state of the art Fourier transform infrared (FT-IR) imaging systems. We show that for large samples or smaller set of discrete frequencies, point scanning far exceeds (∼10-100 fold) comparable data acquired with FT-IR instruments. Further we show improvements in image quality using refractive lenses that show significantly improved contrast across the spatial frequency bandwidth. Finally, we introduce the ability to image two tunable frequencies simultaneously using a single detector by means of demodulation to further speed up data acquisition and reduce the impact of scattering. Together, the advancements provide significantly better spectral quality and spatial fidelity than current state of the art imaging systems while promising to make spectral scanning even faster.

Dielectric Sphere Clusters as a Model to Understand Infrared Spectroscopic Imaging Data Recorded from Complex Samples

Understanding the infrared (IR) spectral response of materials as a function of their morphology is not only of fundamental importance but also of contemporary practical need in the analysis of biological and synthetic materials. While significant work has recently been reported in understanding the spectra of particles with well-defined geometries, we report here on samples that consist of collections of particles. First, we theoretically model the importance of multiple scattering effects and computationally predict the impact of local particles' environment on the recorded IR spectra. Both monodisperse and polydisperse particles are considered in clusters with various degrees of packing. We show that recorded spectra are highly dependent on the cluster morphology and size of particles but the origin of this dependence is largely due to the scattering that depends on morphology and not absorbance that largely depends on the volume of material. The effect of polydispersity is to reduce the fine scattering features in the spectrum, resulting in a closer resemblance to bulk spectra. Fourier transform-IR (FT-IR) spectra of clusters of electromagnetically coupled poly(methyl methacrylate) (PMMA) spheres with wavelength-scale diameters were recorded and compared to simulated results. Measured spectra agreed well with those predicted. Of note, when PMMA spheres occupy a volume greater than 18% of the focal volume, the recorded IR spectrum becomes almost independent of the cluster's morphological changes. This threshold, where absorbance starts to dominate the signal, exactly matches the percolation threshold for hard spheres and quantifies the transition between the single particle and bulk behavior. Our finding enables an understanding of the spectral response of structured samples and points to appropriate models for recovering accurate chemical information from in IR microspectroscopy data.

BIM-Sim: Interactive Simulation of Broadband Imaging Using Mie Theory

Understanding the structure of a scattered electromagnetic (EM) field is critical to improving the imaging process. Mechanisms such as diffraction, scattering, and interference affect an image, limiting the resolution, and potentially introducing artifacts. Simulation and visualization of scattered fields thus plays an important role in imaging science. However, EM fields are high-dimensional, making them time-consuming to simulate, and difficult to visualize. In this paper, we present a framework for interactively computing and visualizing EM fields scattered by micro and nano-particles. Our software uses graphics hardware for evaluating the field both inside and outside of these particles. We then use Monte-Carlo sampling to reconstruct and visualize the three-dimensional structure of the field, spectral profiles at individual points, the structure of the field at the surface of the particle, and the resulting image produced by an optical system.

Towards Translation of Discrete Frequency Infrared Spectroscopic Imaging for Digital Histopathology of Clinical Biopsy Samples

Fourier transform infrared (FT-IR) spectroscopic imaging has been widely tested as a tool for stainless digital histology of biomedical specimens, including for the identification of infiltration and fibrosis in endomyocardial biopsy samples to assess transplant rejection. A major barrier in clinical translation has been the slow speed of imaging. To address this need, we tested and report here the viability of using high speed discrete frequency infrared (DFIR) imaging to obtain stain-free biochemical imaging in cardiovascular samples collected from patients. Images obtained by this method were classified with high accuracy by a Bayesian classification algorithm trained on FT-IR imaging data as well as on DFIR data. A single spectral feature correlated with instances of fibrosis, as identified by the pathologist, highlights the advantage of the DFIR imaging approach for rapid detection. The speed of digital pathologic recognition was at least 16 times faster than the fastest FT-IR imaging instrument. These results indicate that a fast, on-site identification of fibrosis using IR imaging has potential for real time assistance during surgeries. Further, the work describes development and applications of supervised classifiers on DFIR imaging data, comparing classifiers developed on FT-IR and DFIR imaging modalities and identifying specific spectral features for accurate identification of fibrosis. This addresses a topic of much debate on the use of training data and cross-modality validity of IR measurements. Together, the work is a step toward addressing a clinical diagnostic need at acquisition time scales that make IR imaging technology practical for medical use.

Multi-functionality Redefined with Colloidal Carotene Carbon Nanoparticles for Synchronized Chemical Imaging, Enriched Cellular Uptake and Therapy

Typically, multiplexing high nanoparticle uptake, imaging, and therapy requires careful integration of three different functions of a multiscale molecular-particle assembly. Here, we present a simpler approach to multiplexing by utilizing one component of the system for multiple functions. Specifically, we successfully synthesized and characterized colloidal carotene carbon nanoparticle (C(3)-NP), in which a single functional molecule served a threefold purpose. First, the presence of carotene moieties promoted the passage of the particle through the cell membrane and into the cells. Second, the ligand acted as a potent detrimental moiety for cancer cells and, finally, the ligands produced optical contrast for robust microscopic detection in complex cellular environments. In comparative tests, C(3)-NP were found to provide effective intracellular delivery that enables both robust detection at cellular and tissue level and presents significant therapeutic potential without altering the mechanism of intracellular action of β-carotene. Surface coating of C(3) with phospholipid was used to generate C(3)-Lipocoat nanoparticles with further improved function and biocompatibility, paving the path to eventual in vivo studies.

FTIR spectroscopic imaging and mapping with correcting lenses for studies of biological cells and tissues

Histopathology of tissue samples is used to determine the progression of cancer usually by staining and visual analysis. It is recognised that disease progression from healthy tissue to cancerous is accompanied by spectral signature changes in the mid-infrared range. In this work, FTIR spectroscopic imaging in transmission mode using a focal plane array (96 × 96 pixels) has been applied to the characterisation of Barrett's oesophageal adenocarcinoma. To correct optical aberrations, infrared transparent lenses were used of the same material (CaF₂) as the slide on which biopsies were fixed. The lenses acted as an immersion objective, reducing scattering and improving spatial resolution. A novel mapping approach using a sliding lens is presented where spectral images obtained with added lenses are stitched together such that the dataset contained a representative section of the oesophageal tissue. Images were also acquired in transmission mode using high-magnification optics for enhanced spatial resolution, as well as with a germanium micro-ATR objective. The reduction of scattering was assessed using k-means clustering. The same tissue section map, which contained a region of high grade dysplasia, was analysed using hierarchical clustering analysis. A reduction of the trough at 1077 cm⁻¹ in the second derivative spectra was identified as an indicator of high grade dysplasia. In addition, the spatial resolution obtained with the lens using high-magnification optics was assessed by measurements of a sharp interface of polymer laminate, which was also compared with that achieved with micro ATR-FTIR imaging. In transmission mode using the lens, it was determined to be 8.5 μm and using micro-ATR imaging, the resolution was 3 μm for the band at a wavelength of ca. 3 μm. The spatial resolution was also assessed with and without the added lens, in normal and high-magnification modes using a USAF target. Spectroscopic images of cells in transmission mode using two lenses are also presented, which are necessary for correcting chromatic aberration and refraction in both the condenser and objective. The use of lenses is shown to be necessary for obtaining high-quality spectroscopic images of cells in transmission mode and proves the applicability of the pseudo hemisphere approach for this and other microfluidic systems.

Stain-less staining for computed histopathology

Dyes such as hematoxylin and eosin (H&E) and immunohistochemical stains have been increasingly used to visualize tissue composition in research and clinical practice. We present an alternative approach to obtain the same information using stain-free chemical imaging. Relying on Fourier transform infrared (FT-IR) spectroscopic imaging and computation, stainless computed histopathology can enable a rapid, digital, quantitative and non-perturbing visualization of morphology and multiple molecular epitopes simultaneously in a variety of research and clinical pathology applications.