Simultaneous cancer and tumor microenvironment subtyping using confocal infrared microscopy for all-digital molecular histopathology

Combining quantum cascade lasers and plasmonic metasurfaces to monitor de novo lipogenesis with vibrational contrast microscopy

The combination of a tunable quantum cascade laser (QCL) and plasmonic mid-infrared (MIR) metasurface is a powerful tool enabling label-free high-content microscopy of hydrated cells using the vibrational contrast of their constituent biomolecules. While the QCL provides a high-brightness source whose frequency can be rapidly tuned to that of the relevant molecular vibration, the metasurface is used to overcome water absorption of MIR light. Here we employ the resulting Metasurface-enabled Inverted Reflected-light Infrared Absorption Microscopy (MIRIAM) tool for non-destructive monitoring of the vital process of de novo lipogenesis (DNL), by which fat tissue cells (adipocytes) synthesize fatty acids from glucose and store them inside lipid droplets. Using 13 C-labeled glucose as a metabolic probe, we produce spatially- and temporally-resolved images of 13 C incorporation into lipids and proteins, observed as red-shifted vibrational peaks in the MIR spectra. These findings demonstrate MIRIAM's capability for studying metabolic pathways with molecular specificity, offering a powerful platform for label-free imaging of cellular metabolism.

Label-free Aβ plaque detection in Alzheimer's disease brain tissue using infrared microscopy and neural networks

We present a novel method for the label-free detection of amyloid-beta (Aβ) plaques, the key hallmark of Alzheimer's disease, in human brain tissue sections. Conventionally, immunohistochemistry (IHC) is employed for the characterization of Aβ plaques, hindering subsequent analysis. Here, a semi-supervised convolutional neural network (CNN) is trained to detect Aβ plaques in quantum cascade laser infrared (QCL-IR) microscopy images. Laser microdissection (LMD) is then used to precisely extract plaques from snap-frozen, unstained tissue sections. Mass spectrometry-based proteomics reveals a loss of soluble proteins in IHC stained samples. Our method prevents this loss and provides a novel tool that expands the scope of molecular analysis methods to chemically native plaques. Insight into soluble plaque components will complement our understanding of plaques and their role in Alzheimer's disease.

Prediction of post-treatment recurrence in early-stage breast cancer using deep-learning with mid-infrared chemical histopathological imaging

Predicting long-term recurrence of disease in breast cancer (BC) patients remains a significant challenge for patients with early stage disease who are at low to intermediate risk of relapse as determined using current clinical tools. Prognostic assays which utilize bulk transcriptomics ignore the spatial context of the cellular material and are, therefore, of limited value in the development of mechanistic models. In this study, Fourier-transform infrared (FTIR) chemical images of BC tissue were used to train deep learning models to predict future disease recurrence. A number of deep learning models were employed, with champion models employing two-dimensional and two-dimensional-separable convolutional networks found to have predictive performance of a ROC AUC of approximately 0.64, which compares well to other clinically used prognostic assays in this space. All-digital chemical imaging may therefore provide a label-free platform for histopathological prognosis in breast cancer, opening new horizons for future deployment of these technologies.

Mid-infrared chemical imaging of living cells enabled by plasmonic metasurfaces

Mid-Infrared (MIR) chemical imaging provides rich chemical information of biological samples in a label-free and non-destructive manner. Yet, its adoption to live-cell analysis is limited by the strong attenuation of MIR light in water, often necessitating cell culture geometries that are incompatible with the prolonged viability of cells and with standard high-throughput workflow. Here, we introduce a new approach to MIR microscopy, where cells are imaged through their localized near-field interaction with a plasmonic metasurface. Chemical contrast of distinct molecular groups provided sub-cellular resolution images of the proteins, lipids, and nucleic acids in the cells that were collected using an inverted MIR microscope. Time-lapse imaging of living cells demonstrated that their behaviors, including motility, viability, and substrate adhesion, can be monitored over extended periods of time using low-power MIR light. The presented approach provides a method for the non-perturbative MIR imaging of living cells, which is well-suited for integration with modern high-throughput screening technologies for the label-free, high-content chemical imaging of living cells.

Benchtop IR Imaging of Live Cells: Monitoring the Total Mass of Biomolecules in Single Cells

Absolute quantity imaging of biomolecules on a single cell level is critical for measurement assurance in biosciences and bioindustries. While infrared (IR) transmission microscopy is a powerful label-free imaging modality capable of chemical quantification, its applicability to hydrated biological samples remains challenging due to the strong IR absorption by water. Traditional IR imaging of hydrated cells relies on powerful light sources, such as synchrotrons, to mitigate the light absorption by water. However, we overcome this challenge by applying a solvent absorption compensation (SAC) technique to a home-built benchtop IR microscope based on an external-cavity quantum cascade laser. SAC-IR microscopy adjusts the incident light using a pair of polarizers to precompensate the IR absorption by water while retaining the full dynamic range. Integrating the IR absorbance over a cell yields the total mass of biomolecules per cell. We monitor the total mass of the biomolecules of live fibroblast cells over 12 h, demonstrating promise for advancing our understanding of the biomolecular processes occurring in live cells on the single-cell level.

Exploiting Matrix Stiffness to Overcome Drug Resistance

Drug resistance is arguably one of the biggest challenges facing cancer research today. Understanding the underlying mechanisms of drug resistance in tumor progression and metastasis are essential in developing better treatment modalities. Given the matrix stiffness affecting the mechanotransduction capabilities of cancer cells, characterization of the related signal transduction pathways can provide a better understanding for developing novel therapeutic strategies. In this review, we aimed to summarize the recent advancements in tumor matrix biology in parallel to therapeutic approaches targeting matrix stiffness and its consequences in cellular processes in tumor progression and metastasis. The cellular processes governed by signal transduction pathways and their aberrant activation may result in activating the epithelial-to-mesenchymal transition, cancer stemness, and autophagy, which can be attributed to drug resistance. Developing therapeutic strategies to target these cellular processes in cancer biology will offer novel therapeutic approaches to tailor better personalized treatment modalities for clinical studies.

Overtone photothermal microscopy for high-resolution and high-sensitivity vibrational imaging

Photothermal microscopy is a highly sensitive pump-probe method for mapping nanostructures and molecules through the detection of local thermal gradients. While visible photothermal microscopy and mid-infrared photothermal microscopy techniques have been developed, they possess inherent limitations. These techniques either lack chemical specificity or encounter significant light attenuation caused by water absorption. Here, we present an overtone photothermal (OPT) microscopy technique that offers high chemical specificity, detection sensitivity, and spatial resolution by employing a visible probe for local heat detection in the C-H overtone region. We demonstrate its capability for high-fidelity chemical imaging of polymer nanostructures, depth-resolved intracellular chemical mapping of cancer cells, and imaging of multicellular C. elegans organisms and highly scattering brain tissues. By bridging the gap between visible and mid-infrared photothermal microscopy, OPT establishes a new modality for high-resolution and high-sensitivity chemical imaging. This advancement complements large-scale shortwave infrared imaging approaches, facilitating multiscale structural and chemical investigations of materials and biological metabolism.

Sensitive Discrete Frequency Mid-Infrared Absorption Spectroscopy Using Digitally Referenced Detection

Broadly tunable mid-infrared (IR) lasers, including quantum cascade lasers (QCL), are an asset for vibrational spectroscopy wherein high-intensity, coherent illumination can target specific spectral bands for rapid, direct chemical detection with microscopic localization. These emerging spectrometers are capable of high measurement throughputs with large detector signals from the high-intensity lasers and fast detection speeds as short as a single laser pulse, challenging the decades old benchmarks of Fourier transform infrared spectroscopy. However, noise in QCL emissions limits the feasible acquisition time for high signal-to-noise ratio (SNR) data. Here, we present an implementation that is broadly compatible with many laser-based spectrometer and microscope designs to address these limitations by leveraging high-speed digitizers and dual detectors to digitally reference each pulse individually. Digitally referenced detection (DRD) is shown to improve measurement sensitivity, with broad spectral indifference, regardless of imbalance due to dissimilarities among system designs or component manufacturers. We incorporated DRD into existing instruments and demonstrated its generalizability: a spectrometer with a 10-fold reduction in spectral noise, a microscope with reduced pixel dwell times to as low as 1 pulse while maintaining SNR normally achieved when operating 8-fold slower, and finally, a spectrometer to measure vibrational circular dichroism (VCD) with a ∼ 4-fold reduction in scan times. The approach not only proves versatile and effective but can also be tailored for specific applications with minimal hardware changes, positioning it as a simple and promising module for spectrometer designs using lasers.

INSTRAS: INfrared Spectroscopic imaging-based TRAnsformers for medical image Segmentation

Infrared (IR) spectroscopic imaging is of potentially wide use in medical imaging applications due to its ability to capture both chemical and spatial information. This complexity of the data both necessitates using machine intelligence as well as presents an opportunity to harness a high-dimensionality data set that offers far more information than today's manually-interpreted images. While convolutional neural networks (CNNs), including the well-known U-Net model, have demonstrated impressive performance in image segmentation, the inherent locality of convolution limits the effectiveness of these models for encoding IR data, resulting in suboptimal performance. In this work, we propose an INfrared Spectroscopic imaging-based TRAnsformers for medical image Segmentation (INSTRAS). This novel model leverages the strength of the transformer encoders to segment IR breast images effectively. Incorporating skip-connection and transformer encoders, INSTRAS overcomes the issue of pure convolution models, such as the difficulty of capturing long-range dependencies. To evaluate the performance of our model and existing convolutional models, we conducted training on various encoder-decoder models using a breast dataset of IR images. INSTRAS, utilizing 9 spectral bands for segmentation, achieved a remarkable AUC score of 0.9788, underscoring its superior capabilities compared to purely convolutional models. These experimental results attest to INSTRAS's advanced and improved segmentation abilities for IR imaging.

Structural characterization of amyloid aggregates with spatially resolved infrared spectroscopy

The self-assembly of proteins and peptides into ordered structures called amyloid fibrils is a hallmark of numerous diseases, impacting the brain, heart, and other organs. The structure of amyloid aggregates is central to their function and thus has been extensively studied. However, the structural heterogeneities between aggregates as they evolve throughout the aggregation pathway are still not well understood. Conventional biophysical spectroscopic methods are bulk techniques and only report on the average structural parameters. Understanding the structure of individual aggregate species in a heterogeneous ensemble necessitates spatial resolution on the length scale of the aggregates. Recent technological advances have led to augmentation of infrared (IR) spectroscopy with imaging modalities, wherein the photothermal response of the sample upon vibrational excitation is leveraged to provide spatial resolution beyond the diffraction limit. These combined approaches are ideally suited to map out the structural heterogeneity of amyloid ensembles. AFM-IR, which integrates IR spectroscopy with atomic force microscopy enables identification of the structural facets the oligomers and fibrils at individual aggregate level with nanoscale resolution. These capabilities can be extended to chemical mapping in diseased tissue specimens with submicron resolution using optical photothermal microscopy, which combines IR spectroscopy with optical imaging. This book chapter provides the basic premise of these novel techniques and provides the typical methodology for using these approaches for amyloid structure determination. Detailed procedures pertaining to sample preparation and data acquisition and analysis are discussed and the aggregation of the amyloid β peptide is provided as a case study to provide the reader the experimental parameters necessary to use these techniques to complement their research efforts.

Inverted Transflection Spectroscopy of Live Cells Using Metallic Grating on Elevated Nanopillars

Water absorption of mid-infrared (MIR) radiation severely limits the options for vibrational spectroscopy of the analytes-including live biological cells-that must be probed in aqueous environments. While internal reflection elements, such as attenuated total reflection prisms and metasurfaces, partially overcome this limitation, such devices have their own limitations: ATR prisms are difficult to integrate with multiwell cell culture workflows, while metasurfaces suffer from a limited spectral range and small penetration depth into analytes. In this work, we introduce an alternative live cell biosensing platform based on metallic nanogratings fabricated on top of elevated dielectric pillars. For the MIR wavelengths that are significantly longer than the grating period, reflection-based spectroscopy enables broadband sensing of the analytes inside the trenches separating the dielectric pillars. Because the depth of the analyte twice-traversed by the MIR light excludes the highly absorbing thick water layer above the grating, we refer to the technique as inverted transflection spectroscopy (ITS). The analytic power of ITS is established by measuring a wide range of protein concentrations in solution, with the limit of detection in the single-digit mg mL-1. The ability of ITS to interrogate live cells that naturally wrap themselves around the grating is used to characterize their adhesion kinetic.

Fast cancer imaging in pancreatic biopsies using infrared imaging

Pancreatic cancer, particularly Pancreatic ductal adenocarcinoma, remains a highly lethal form of cancer with limited early diagnosis and treatment options. Infrared (IR) spectroscopy, combined with machine learning, has demonstrated great potential in detecting various cancers. This study explores the translation of a diagnostic model from Fourier Transform Infrared to Quantum Cascade Laser (QCL) microscopy for pancreatic cancer classification. Furthermore, QCL microscopy offers faster measurements with selected frequencies, improving clinical feasibility. Thus, the goals of the study include establishing a QCL-based model for pancreatic cancer classification and creating a fast surgical margin detection model using reduced spectral information. The research involves preprocessing QCL data, training Random Forest (RF) classifiers, and optimizing the selection of spectral features for the models. Results demonstrate successful translation of the diagnostic model to QCL microscopy, achieving high predictive power (AUC = 98%) in detecting cancerous tissues. Moreover, a model for rapid surgical margin recognition, based on only a few spectral frequencies, is developed with promising differentiation between benign and cancerous regions. The findings highlight the potential of QCL microscopy for efficient pancreatic cancer diagnosis and surgical margin detection within clinical timeframes of minutes per surgical resection tissue.

Infrared Spectroscopy for Rapid Triage of Cancer Using Blood Derivatives: A Reality Check

Infrared (IR) spectroscopy of serum/plasma represents an alluring molecular diagnostic tool, especially for cancer, as it can provide a molecular fingerprint of clinical samples based on vibrational modes of chemical bonds. However, despite the superior performance, the routine adoption of this technique for clinical settings has remained elusive. This is due to the potential confounding factors that are often overlooked and pose a significant barrier to clinical translation. In this Perspective, we summarize the concerns associated with various confounding factors, such as fluid sampling, optical effects, hemolysis, abnormal cardiovascular and/or hepatic functions, infections, alcoholism, diet style, age, and gender of a patient or normal control cohort, and improper selection of numerical methods that ultimately would lead to improper spectral diagnosis. We also propose some precautionary measures to overcome the challenges associated with these confounding factors.

Deep learning analysis of mid-infrared microscopic imaging data for the diagnosis and classification of human lymphomas

The present study presents an alternative analytical workflow that combines mid-infrared (MIR) microscopic imaging and deep learning to diagnose human lymphoma and differentiate between small and large cell lymphoma. We could show that using a deep learning approach to analyze MIR hyperspectral data obtained from benign and malignant lymph node pathology results in high accuracy for correct classification, learning the distinct region of 3900 to 850 cm-1 . The accuracy is above 95% for every pair of malignant lymphoid tissue and still above 90% for the distinction between benign and malignant lymphoid tissue for binary classification. These results demonstrate that a preliminary diagnosis and subtyping of human lymphoma could be streamlined by applying a deep learning approach to analyze MIR spectroscopic data.

Intermediate Antiparallel β Structure in Amyloid β Plaques Revealed by Infrared Spectroscopic Imaging

Aggregation of amyloid β (Aβ) peptides into extracellular plaques is a hallmark of the molecular pathology of Alzheimer's disease (AD). Amyloid aggregates have been extensively studied in vitro, and it is well-known that mature amyloid fibrils contain an ordered parallel β structure. The structural evolution from unaggregated peptide to fibrils can be mediated through intermediate structures that deviate significantly from mature fibrils, such as antiparallel β-sheets. However, it is currently unknown if these intermediate structures exist in plaques, which limits the translation of findings from in vitro structural characterizations of amyloid aggregates to AD. This arises from the inability to extend common structural biology techniques to ex vivo tissue measurements. Here we report the use of infrared (IR) imaging, wherein we can spatially localize plaques and probe their protein structural distributions with the molecular sensitivity of IR spectroscopy. Analyzing individual plaques in AD tissues, we demonstrate that fibrillar amyloid plaques exhibit antiparallel β-sheet signatures, thus providing a direct connection between in vitro structures and amyloid aggregates in the AD brain. We further validate results with IR imaging of in vitro aggregates and show that the antiparallel β-sheet structure is a distinct structural facet of amyloid fibrils.

Inverted transflection spectroscopy of live cells using metallic grating on elevated nanopillars

Water absorption of mid-infrared (MIR) radiation severely limits the options for vibrational spectroscopy of the analytes - including live biological cells - that must be probed in aqueous environments. While internal reflection elements, such as attenuated total reflection prisms and metasurfaces, partially overcome this limitation, such devices have their own limitations: high cost, incompatibility with standard cell culture workflows, limited spectral range, and small penetration depth into the analyte. In this work, we introduce an alternative live cell biosensing platform based on metallic nanogratings fabricated atop elevated dielectric pillars. For the MIR wavelengths that are significantly longer than the grating period, reflection-based spectroscopy enables broadband sensing of the analytes inside the trenches separating the dielectric pillars. Because the depth of the analyte twice-traversed by the MIR light excludes the highly absorbing thick water layer above the grating, we refer to the technique as Inverted Transflection Spectroscopy (ITS). We demonstrate the analytic power of ITS by measuring protein concentrations in solution. The ability of ITS to interrogate live cells that naturally wrap themselves around the grating is also exploited to characterize their adhesion kinetics.

Accelerating Cancer Histopathology Workflows with Chemical Imaging and Machine Learning

Histopathology has remained a cornerstone for biomedical tissue assessment for over a century, with a resource-intensive workflow involving biopsy or excision, gross examination, sampling, tissue processing to snap frozen or formalin-fixed paraffin-embedded blocks, sectioning, staining, optical imaging, and microscopic assessment. Emerging chemical imaging approaches, including stimulated Raman scattering (SRS) microscopy, can directly measure inherent molecular composition in tissue (thereby dispensing with the need for tissue processing, sectioning, and using dyes) and can use artificial intelligence (AI) algorithms to provide high-quality images. Here we show the integration of SRS microscopy in a pathology workflow to rapidly record chemical information from minimally processed fresh-frozen prostate tissue. Instead of using thin sections, we record data from intact thick tissues and use optical sectioning to generate images from multiple planes. We use a deep learning–based processing pipeline to generate virtual hematoxylin and eosin images. Next, we extend the computational method to generate archival-quality images in minutes, which are equivalent to those obtained from hours/days-long formalin-fixed, paraffin-embedded processing. We assessed the quality of images from the perspective of enabling pathologists to make decisions, demonstrating that the virtual stained image quality was diagnostically useful and the interpathologist agreement on prostate cancer grade was not impacted. Finally, because this method does not wash away lipids and small molecules, we assessed the utility of lipid chemical composition in determining grade. Together, the combination of chemical imaging and AI provides novel capabilities for rapid assessments in pathology by reducing the complexity and burden of current workflows.

SIGNIFICANCE

Archival-quality (formalin-fixed paraffin-embedded), thin-section diagnostic images are obtained from thick-cut, fresh-frozen prostate tissues without dyes or stains to expedite cancer histopathology by combining SRS microscopy and machine learning.

Infrared spectroscopic laser scanning confocal microscopy for whole-slide chemical imaging

Chemical imaging, especially mid-infrared spectroscopic microscopy, enables label-free biomedical analyses while achieving expansive molecular sensitivity. However, its slow speed and poor image quality impede widespread adoption. We present a microscope that provides high-throughput recording, low noise, and high spatial resolution where the bottom-up design of its optical train facilitates dual-axis galvo laser scanning of a diffraction-limited focal point over large areas using custom, compound, infinity-corrected refractive objectives. We demonstrate whole-slide, speckle-free imaging in ~3 min per discrete wavelength at 10× magnification (2 μm/pixel) and high-resolution capability with its 20× counterpart (1 μm/pixel), both offering spatial quality at theoretical limits while maintaining high signal-to-noise ratios (>100:1). The data quality enables applications of modern machine learning and capabilities not previously feasible - 3D reconstructions using serial sections, comprehensive assessments of whole model organisms, and histological assessments of disease in time comparable to clinical workflows. Distinct from conventional approaches that focus on morphological investigations or immunostaining techniques, this development makes label-free imaging of minimally processed tissue practical.

High-speed scanless entire bandwidth mid-infrared chemical imaging

Mid-infrared spectroscopy probes molecular vibrations to identify chemical species and functional groups. Therefore, mid-infrared hyperspectral imaging is one of the most powerful and promising candidates for chemical imaging using optical methods. Yet high-speed and entire bandwidth mid-infrared hyperspectral imaging has not been realized. Here we report a mid-infrared hyperspectral chemical imaging technique that uses chirped pulse upconversion of sub-cycle pulses at the image plane. This technique offers a lateral resolution of 15 µm, and the field of view is adjustable between 800 µm × 600 µm to 12 mm × 9 mm. The hyperspectral imaging produces a 640 × 480 pixel image in 8 s, which covers a spectral range of 640-3015 cm^-1, comprising 1069 wavelength points and offering a wavenumber resolution of 2.6-3.7 cm^-1. For discrete frequency mid-infrared imaging, the measurement speed reaches a frame rate of 5 kHz, the repetition rate of the laser. As a demonstration, we effectively identified and mapped different components in a microfluidic device, plant cell, and mouse embryo section. The great capacity and latent force of this technique in chemical imaging promise to be applied to many fields such as chemical analysis, biology, and medicine.

Nonlinear Imaging Histopathology: A Pipeline to Correlate Gold-Standard Hematoxylin and Eosin Staining With Modern Nonlinear Microscopy

Hematoxylin and eosin (H&E) staining, the century-old technique, has been the gold standard tool for pathologists to detect anomalies in tissues and diseases such as cancer. H&E staining is a cumbersome, time-consuming process that delays and wastes precious minutes during an intraoperative diagnosis. However, even in the modern era, real-time label-free imaging techniques such as simultaneous label-free autofluorescence multiharmonic (SLAM) microscopy have delivered several more layers of information to characterize a tissue with high precision. Still, they have yet to translate to the clinic. The slow translation rate can be attributed to the lack of direct comparisons between the old and new techniques. Our approach to solving this problem is to: 1) reduce dimensions by pre-sectioning the tissue in 500 μm slices, and 2) produce fiducial laser markings which appear in both SLAM and histological imaging. High peak-power femtosecond laser pulses enable ablation in a controlled and contained manner. We perform laser marking on a grid of points encompassing the SLAM region of interest. We optimize laser power, numerical aperture, and timing to produce axially extended marking, hence multilayered fiducial markers, with minimal damage to the surrounding tissues. We performed this co-registration over an area of 3 × 3 mm2 of freshly excised mouse kidney and intestine, followed by standard H&E staining. Reduced dimensionality and the use of laser markings provided a comparison of the old and new techniques, giving a wealth of correlative information and elevating the potential of translating nonlinear microscopy to the clinic for rapid pathological assessment.

Comprehensive Histopathology Imaging in Pancreatic Biopsies: High Definition Infrared Imaging with Machine Learning Approach

Infrared (IR) based histopathology offers a new paradigm in looking at tissues and can provide a complimentary information source for more classical histopathology, which makes it a noteworthy tool given possible clinical application. This study aims to build a robust, pixel level machine learning model for pancreatic cancer detection using IR imaging. In this article, we report a pancreatic cancer classification model based on data from over 600 biopsies (coming from 250 patients) imaged with IR diffraction-limited spatial resolution. To fully research model's classification ability, we measured tissues using two optical setups, resulting in Standard and High Definitions data. This forms one of the largest IR datasets analyzed up to now, with almost 700 million spectra of different tissue types. The first six-class model created for comprehensive histopathology achieved pixel (tissue) level AUC values above 0.95, giving a successful technique for digital staining with biochemical information extracted from IR spectra.

Video-rate mid-infrared photothermal imaging by single-pulse photothermal detection per pixel

By optically sensing absorption-induced photothermal effect, mid-infrared (IR) photothermal (MIP) microscope enables super-resolution IR imaging of biological systems in water. However, the speed of current sample-scanning MIP system is limited to milliseconds per pixel, which is insufficient for capturing living dynamics. By detecting the transient photothermal signal induced by a single IR pulse through fast digitization, we report a laser-scanning MIP microscope that increases the imaging speed by three orders of magnitude. To realize single-pulse photothermal detection, we use synchronized galvo scanning of both mid-IR and probe beams to achieve an imaging line rate of more than 2 kilohertz. With video-rate speed, we observed the dynamics of various biomolecules in living organisms at multiple scales. Furthermore, by using hyperspectral imaging, we chemically dissected the layered ultrastructure of fungal cell wall. Last, with a uniform field of view more than 200 by 200 square micrometer, we mapped fat storage in free-moving Caenorhabditis elegans and live embryos.

Digital Histopathology by Infrared Spectroscopic Imaging

Infrared (IR) spectroscopic imaging records spatially resolved molecular vibrational spectra, enabling a comprehensive measurement of the chemical makeup and heterogeneity of biological tissues. Combining this novel contrast mechanism in microscopy with the use of artificial intelligence can transform the practice of histopathology, which currently relies largely on human examination of morphologic patterns within stained tissue. First, this review summarizes IR imaging instrumentation especially suited to histopathology, analyses of its performance, and major trends. Second, an overview of data processing methods and application of machine learning is given, with an emphasis on the emerging use of deep learning. Third, a discussion on workflows in pathology is provided, with four categories proposed based on the complexity of methods and the analytical performance needed. Last, a set of guidelines, termed experimental and analytical specifications for spectroscopic imaging in histopathology, are proposed to help standardize the diversity of approaches in this emerging area.

A mid-infrared laser microscope for the time-resolved study of light-induced protein conformational changes

We have developed a confocal laser microscope operating in the mid-infrared range for the study of light-sensitive proteins, such as rhodopsins. The microscope features a co-aligned infrared and visible illumination path for the selective excitation and probing of proteins located in the IR focus only. An external-cavity tunable quantum cascade laser provides a wavelength tuning range (5.80-6.35 µm or 1570-1724 cm-1) suitable for studying protein conformational changes as a function of time delay after visible light excitation with a pulsed LED. Using cryogen-free detectors, the relative changes in the infrared absorption of rhodopsin thin films around 10-4 have been observed with a time resolution down to 30 ms. The measured full-width at half maximum of the Airy disk at λ = 6.08 µm in transmission mode with a confocal arrangement of apertures is 6.6 µm or 1.1λ. Dark-adapted sample replacement at the beginning of each photocycle is then enabled by exchanging the illuminated thin-film location with the microscope mapping stage synchronized to data acquisition and LED excitation and by averaging hundreds of time traces acquired in different nearby locations within a homogeneous film area. We demonstrate that this instrument provides crucial advantages for time-resolved IR studies of rhodopsin thin films with a slow photocycle. Time-resolved studies of inhomogeneous samples may also be possible with the presented instrument.

Spatial Omics Imaging of Fresh-Frozen Tissue and Routine FFPE Histopathology of a Single Cancer Needle Core Biopsy: A Freezing Device and Multimodal Workflow

The complex molecular alterations that underlie cancer pathophysiology are studied in depth with omics methods using bulk tissue extracts. For spatially resolved tissue diagnostics using needle biopsy cores, however, histopathological analysis using stained FFPE tissue and the immunohistochemistry (IHC) of a few marker proteins is currently the main clinical focus. Today, spatial omics imaging using MSI or IRI is an emerging diagnostic technology for the identification and classification of various cancer types. However, to conserve tissue-specific metabolomic states, fast, reliable, and precise methods for the preparation of fresh-frozen (FF) tissue sections are crucial. Such methods are often incompatible with clinical practice, since spatial metabolomics and the routine histopathology of needle biopsies currently require two biopsies for FF and FFPE sampling, respectively. Therefore, we developed a device and corresponding laboratory and computational workflows for the multimodal spatial omics analysis of fresh-frozen, longitudinally sectioned needle biopsies to accompany standard FFPE histopathology of the same biopsy core. As a proof-of-concept, we analyzed surgical human liver cancer specimens using IRI and MSI with precise co-registration and, following FFPE processing, by sequential clinical pathology analysis of the same biopsy core. This workflow allowed for a spatial comparison between different spectral profiles and alterations in tissue histology, as well as a direct comparison for histological diagnosis without the need for an extra biopsy.

Intermediate antiparallel beta structure in amyloid plaques revealed by infrared spectroscopic imaging

Aggregation of amyloid beta (Aβ) peptides into extracellular plaques is a hallmark of the molecular pathology of Alzheimer's disease (AD). Amyloid aggregates have been extensively studied in-vitro, and it is well known that mature amyloid fibrils contain an ordered parallel β structure. The structural evolution from unaggregated peptide to fibrils can be mediated through intermediate structures that deviate significantly from mature fibrils, such as antiparallel β-sheets. However, it is currently unknown if these intermediate structures exist in plaques, which limits the translation of findings from in-vitro structural characterizations of amyloid aggregates to AD. This arises from the inability to extend common structural biology techniques to ex-vivo tissue measurements. Here we report the use of infrared (IR) imaging, wherein we can spatially localize plaques and probe their protein structural distributions with the molecular sensitivity of IR spectroscopy. Analyzing individual plaques in AD tissues, we demonstrate that fibrillar amyloid plaques exhibit antiparallel β-sheet signatures, thus providing a direct connection between in-vitro structures and amyloid aggregates in AD brain. We further validate results with IR imaging of in-vitro aggregates and show that antiparallel β-sheet structure is a distinct structural facet of amyloid fibrils.

A one-dimensional convolutional neural network based deep learning for high accuracy classification of transformation stages in esophageal squamous cell carcinoma tissue using micro-FTIR

Among the most frequently diagnosed cancers in developing countries, esophageal squamous cell carcinoma (ESCC) ranks among the top six causes of death. It would be beneficial if a rapid, accurate, and automatic ESCC diagnostic method could be developed to reduce the workload of pathologists and improve the effectiveness of cancer treatments. Using micro-FTIR spectroscopy, this study classified the transformation stages of ESCC tissues. Based on 6,352 raw micro-FTIR spectra, a one-dimensional convolutional neural network (1D-CNN) model was constructed to classify-five stages. Based on the established model, more than 93% accuracy was achieved at each stage, and the accuracy of identifying proliferation, low grade neoplasia, and ESCC cancer groups was achieved 99% for the test dataset. In this proof-of-concept study, the developed method can be applied to other diseases in order to promote the use of FTIR spectroscopy in cancer pathology.

Cell Phase Identification in a Three-Dimensional Engineered Tumor Model by Infrared Spectroscopic Imaging

Cell cycle progression plays a vital role in regulating proliferation, metabolism, and apoptosis. Three-dimensional (3D) cell cultures have emerged as an important class of in vitro disease models, and incorporating the variation occurring from cell cycle progression in these systems is critical. Here, we report the use of Fourier transform infrared (FT-IR) spectroscopic imaging to identify subtle biochemical changes within cells, indicative of the G1/S and G2/M phases of the cell cycle. Following previous studies, we first synchronized samples from two-dimensional (2D) cell cultures, confirmed their states by flow cytometry and DNA quantification, and recorded spectra. We determined two critical wavenumbers (1059 and 1219 cm-1) as spectral indicators of the cell cycle for a set of isogenic breast cancer cell lines (MCF10AT series). These two simple spectral markers were then applied to distinguish cell cycle stages in a 3D cell culture model using four cell lines that represent the main stages of cancer progression from normal cells to metastatic disease. Temporal dependence of spectral biomarkers during acini maturation validated the hypothesis that the cells are more proliferative in the early stages of acini development; later stages of the culture showed stability in the overall composition but unique spatial differences in cells in the two phases. Altogether, this study presents a computational and quantitative approach for cell phase analysis in tissue-like 3D structures without any biomarker staining and provides a means to characterize the impact of the cell cycle on 3D biological systems and disease diagnostic studies using IR imaging.

Dielectric dispersion characteristics of the phospholipid bilayer with subnanometer resolution from terahertz to mid-infrared

There is growing interest in whether the myelinated nerve fiber acts as a dielectric waveguide to propagate terahertz to mid-infrared electromagnetic waves, which are presumed stable signal carrier for neurotransmission. The myelin sheath is formed as a multilamellar biomembrane structure, hence insights into the dielectric properties of the phospholipid bilayer is essential for a complete understanding of the myelinated fiber functioning. In this work, by means of atomistic molecular dynamics simulations of the dimyristoylphosphatidylcholine (DMPC) bilayer in water and numerical calculations of carefully layered molecules along with calibration of optical dielectric constants, we for the first time demonstrate the spatially resolved (in sub-nm) dielectric spectrum of the phospholipid bilayer in a remarkably wide range from terahertz to mid-infrared. More specifically, the membrane head regions exhibit both larger real and imaginary permittivities than that of the tail counterparts in the majority of the 1–100 THz band. In addition, the spatial variation of dielectric properties suggests advantageous propagation characteristics of the phospholipid bilayer in a relatively wide band of 55–85 THz, where the electromagnetic waves are well confined within the head regions.

Nanoscale Infrared Spectroscopy Identifies Structural Heterogeneity in Individual Amyloid Fibrils and Prefibrillar Aggregates

Amyloid plaques are one of the central manifestations of Alzheimer's disease pathology. Aggregation of the amyloid beta (Aβ) protein from amorphous oligomeric species to mature fibrils has been extensively studied. However, structural heterogeneities in prefibrillar species, and how that affects the structure of later-stage aggregates are not yet well understood. The integration of infrared spectroscopy with atomic force microscopy (AFM-IR) allows for identifying the signatures of individual nanoscale aggregates by spatially resolving spectra. We use AFM-IR to demonstrate that amyloid oligomers exhibit significant structural variations as evidenced in their infrared spectra. This heterogeneity is transmitted to and retained in protofibrils and fibrils. We show that amyloid fibrils do not always conform to their putative ordered structure and structurally different domains exist in the same fibril. We further demonstrate that these structural heterogeneities manifest themselves as a lack of β sheet structure in amyloid plaques in Alzheimer's tissue using infrared imaging.

Computational pathology in ovarian cancer

Histopathologic evaluations of tissue sections are key to diagnosing and managing ovarian cancer. Pathologists empirically assess and integrate visual information, such as cellular density, nuclear atypia, mitotic figures, architectural growth patterns, and higher-order patterns, to determine the tumor type and grade, which guides oncologists in selecting appropriate treatment options. Latent data embedded in pathology slides can be extracted using computational imaging. Computers can analyze digital slide images to simultaneously quantify thousands of features, some of which are visible with a manual microscope, such as nuclear size and shape, while others, such as entropy, eccentricity, and fractal dimensions, are quantitatively beyond the grasp of the human mind. Applications of artificial intelligence and machine learning tools to interpret digital image data provide new opportunities to explore and quantify the spatial organization of tissues, cells, and subcellular structures. In comparison to genomic, epigenomic, transcriptomic, and proteomic patterns, morphologic and spatial patterns are expected to be more informative as quantitative biomarkers of complex and dynamic tumor biology. As computational pathology is not limited to visual data, nuanced subvisual alterations that occur in the seemingly “normal” pre-cancer microenvironment could facilitate research in early cancer detection and prevention. Currently, efforts to maximize the utility of computational pathology are focused on integrating image data with other -omics platforms that lack spatial information, thereby providing a new way to relate the molecular, spatial, and microenvironmental characteristics of cancer. Despite a dire need for improvements in ovarian cancer prevention, early detection, and treatment, the ovarian cancer field has lagged behind other cancers in the application of computational pathology. The intent of this review is to encourage ovarian cancer research teams to apply existing and/or develop additional tools in computational pathology for ovarian cancer and actively contribute to advancing this important field.

Resolution Limit in Infrared Chemical Imaging

Chemical imaging combines the spatial specificity of optical microscopy with the spectral selectivity of vibrational spectroscopy. Mid-infrared (IR) absorption imaging instruments are now able to capture high-quality spectra with microscopic spatial detail, but the limits of their ability to resolve spatial and spectral objects remain less understood. In particular, the sensitivity of measurements to chemical and spatial changes and rules for optical design have been presented, but the influence of spectral information on spatial sensitivity is as yet relatively unexplored. We report an information theory-based approach to quantify the spatial localization capability of spectral data in chemical imaging. We explicitly consider the joint effects of the signal-to-noise ratio and spectral separation that have significance in experimental settings to derive resolution limits in IR spectroscopic imaging.

Probing the Drug Dynamics of Chemotherapeutics Using Metasurface-Enhanced Infrared Reflection Spectroscopy of Live Cells

Infrared spectroscopy has drawn considerable interest in biological applications, but the measurement of live cells is impeded by the attenuation of infrared light in water. Metasurface-enhanced infrared reflection spectroscopy (MEIRS) had been shown to mitigate the problem, enhance the cellular infrared signal through surface-enhanced infrared absorption, and encode the cellular vibrational signatures in the reflectance spectrum at the same time. In this study, we used MEIRS to study the dynamic response of live cancer cells to a newly developed chemotherapeutic metal complex with distinct modes of action (MoAs): tricarbonyl rhenium isonitrile polypyridyl (TRIP). MEIRS measurements demonstrated that administering TRIP resulted in long-term (several hours) reduction in protein, lipid, and overall refractive index signals, and in short-term (tens of minutes) increase in these signals, consistent with the induction of endoplasmic reticulum stress. The unique tricarbonyl IR signature of TRIP in the bioorthogonal spectral window was monitored in real time, and was used as an infrared tag to detect the precise drug delivery time that was shown to be closely correlated with the onset of the phenotypic response. These results demonstrate that MEIRS is an effective label-free real-time cellular assay capable of detecting and interpreting the early phenotypic responses of cells to IR-tagged chemotherapeutics.

Label-free multimodal nonlinear optical imaging of needle biopsy cores for intraoperative cancer diagnosis

SIGNIFICANCE

Needle biopsy (NB) procedures are important for the initial diagnosis of many types of cancer. However, the possibility of NB specimens being unable to provide diagnostic information, (i.e., non-diagnostic sampling) and the time-consuming histological evaluation process can cause delays in diagnoses that affect patient care.

AIM

We aim to demonstrate the advantages of this label-free multimodal nonlinear optical imaging (NLOI) technique as a non-destructive point-of-procedure evaluation method for NB tissue cores, for the visualization and characterization of the tissue microenvironment.

APPROACH

A portable, label-free, multimodal NLOI system combined second-harmonic generation (SHG) and third-harmonic generation and two- and three-photon autofluorescence (2PF, 3PF) microscopy. It was used for intraoperative imaging of fresh NB tissue cores acquired during canine cancer surgeries, which involved liver, lung, and mammary tumors as well as soft-tissue sarcoma; in total, eight canine patients were recruited. An added tissue culture chamber enabled the use of this NLOI system for longitudinal imaging of fresh NB tissue cores taken from an induced rat mammary tumor and healthy mouse livers.

RESULTS

The intraoperative NLOI system was used to assess fresh canine NB specimens during veterinary cancer surgeries. Histology-like morphological features were visualized by the combination of four NLOI modalities at the point-of-procedure. The NLOI results provided quantitative information on the tissue microenvironment such as the collagen fiber orientation using Fourier-domain SHG analysis and metabolic profiling by optical redox ratio (ORR) defined by 2PF/(2PF + 3PF). The analyses showed that the canine mammary tumor had more randomly oriented collagen fibers compared to the tumor margin, and hepatocarcinoma had a wider distribution of ORR with a lower mean value compared to the liver fibrosis and the normal-appearing liver. Moreover, the loss of metabolic information during tissue degradation of fresh murine NB specimens was shown by overall intensity decreases in all channels and an increase of mean ORR from 0.94 (standard deviation 0.099) to 0.97 (standard deviation 0.077) during 1-h longitudinal imaging of a rat mammary tumor NB specimen. The tissue response to staurosporine (STS), an apoptotic inducer, from fresh murine liver NB specimens was also observed. The mean ORR decreased from 0.86 to 0.74 in the first 40 min and then increased to 0.8 during the rest of the hour of imaging, compared to the imaging results without the addition of STS, which showed a continuous increase of ORR from 0.72 to 0.75.

CONCLUSIONS

A label-free, multimodal NLOI platform reveals microstructural and metabolic information of the fresh NB cores during intraoperative cancer imaging. This system has been demonstrated on animal models to show its potential to provide a more comprehensive histological assessment and a better understanding of the unperturbed tumor microenvironment. Considering tissue degradation, or loss of viability upon fixation, this intraoperative NLOI system has the advantage of immediate assessment of freshly excised tissue specimens at the point of procedure.

'On the Spot' Digital Pathology of Breast Cancer Based on Single-Cell Mass Spectrometry Imaging

The molecular pathology of breast cancer is challenging due to the complex heterogeneity of cellular subtypes. The ability to directly identify and visualize cell subtype distribution at the single-cell level within a tissue section enables precise and rapid diagnosis and prognosis. Here, we applied mass spectrometry imaging (MSI) to acquire and visualize the molecular profiles at the single-cell and subcellular levels of 14 different breast cancer cell lines. We built a molecular library of genetically well-characterized cell lines. Multistep processing, including deep learning, resulted in a breast cancer subtype, the cancer's hormone status, and a genotypic recognition model based on metabolic phenotypes with cross-validation rates of up to 97%. Moreover, we applied our single-cell-based recognition models to complex tissue samples, identifying cell subtypes in tissue context within seconds during measurement. These data demonstrate "on the spot" digital pathology at the single-cell level using MSI, and they provide a framework for fast and accurate high spatial resolution diagnostics and prognostics.

Statistical Considerations and Tools to Improve Histopathologic Protocols with Spectroscopic Imaging

Advances in infrared (IR) spectroscopic imaging instrumentation and data science now present unique opportunities for large validation studies of the concept of histopathology using spectral data. In this study, we examine the discrimination potential of IR metrics for different histologic classes to estimate the sample size needed for designing validation studies to achieve a given statistical power and statistical significance. Next, we present an automated annotation transfer tool that can allow large-scale training/validation, overcoming the limitations of sparse ground truth data with current manual approaches by providing a tool to transfer pathologist annotations from stained images to IR images across diagnostic categories. Finally, the results of a combination of supervised and unsupervised analysis provide a scheme to identify diagnostic groups/patterns and isolating pure chemical pixels for each class to better train complex histopathological models. Together, these methods provide essential tools to take advantage of the emerging capabilities to record and utilize large spectroscopic imaging datasets.

Polarization Sensitive Photothermal Mid-Infrared Spectroscopic Imaging of Human Bone Marrow Tissue

Collagen quantity and integrity play an important role in understanding diseases such as myelofibrosis (MF). Label-free mid-infrared spectroscopic imaging (MIRSI) has the potential to quantify collagen while minimizing the subjective variance observed with conventional histopathology. Infrared (IR) spectroscopy with polarization sensitivity provides chemical information while also estimating tissue dichroism. This can potentially aid MF grading by revealing the structure and orientation of collagen fibers. Simultaneous measurement of collagen structure and biochemical properties can translate clinically into improved diagnosis and enhance our understanding of disease progression. In this paper, we present the first report of polarization-dependent spectroscopic variations in collagen from human bone marrow samples. We build on prior work with animal models and extend it to human clinical biopsies with a practical method for high-resolution chemical and structural imaging of bone marrow on clinical glass slides. This is done using a new polarization-sensitive photothermal mid-infrared spectroscopic imaging scheme that enables sample and source independent polarization control. This technology provides 0.5 µm spatial resolution, enabling the identification of thin (≈1 µm) collagen fibers that were not separable using Fourier Transform Infrared (FT-IR) imaging in the fingerprint region at diffraction-limited resolution ( ≈ 5 µm). Finally, we propose quantitative metrics to identify fiber orientation from discrete band images (amide I and amide II) measured under three polarizations. Previous studies have used a pair of orthogonal polarization measurements, which is insufficient for clinical samples since human bone biopsies contain collagen fibers with multiple orientations. Here, we address this challenge and demonstrate that three polarization measurements are necessary to resolve orientation ambiguity in clinical bone marrow samples. This is also the first study to demonstrate the ability to spectroscopically identify thin collagen fibers (≈1 µm diameter) and their orientations, which is critical for accurate grading of human bone marrow fibrosis.

Infrared Spectroscopic Analysis in the Differentiation of Epithelial Misplacement From Adenocarcinoma in Sigmoid Colonic Adenomatous Polyps

Purpose

The differential diagnosis of epithelial misplacement from invasive cancer in the colon is a challenging endeavour, augmented by the introduction of bowel cancer population screening. The main aim of the work is to test, as a proof-of concept study, the ability of the infrared spectroscopic imaging approach to differentiate epithelial misplacement from adenocarcinoma in sigmoid colonic adenomatous polyps.

Methods

Ten samples from each of the four diagnostic groups, normal colonic mucosa, adenomatous polyps with low grade dysplasia, epithelial misplacement in adenomatous polyps and adenocarcinoma, were analysed using IR spectroscopic imaging and data processing methods. IR spectral images were subjected to data pre-processing and cluster analysis based segmentation to identify epithelial, connective tissue and stromal regions. Statistical analysis was carried out using principal component analysis and linear discriminant analysis based cross validation, to classify spectral features according to the pathology, and the diagnostic attributes were compared.

Results

The combined 4-group classification model on an average showed a sensitivity of 64%, a specificity of 88% and an accuracy of 76% for prediction based on a 'single spectrum', whilst a 'majority-vote' prediction on an average showed a sensitivity of 73%, a specificity of 90% and an accuracy of 82%. The 2-group model, for the differential diagnosis of epithelial misplacement versus adenocarcinoma, showed an average sensitivity and specificity of 82.5% for prediction based on a 'single spectrum' whilst a 'majority-vote' classification showed an average sensitivity and specificity of 90%. A 92% area under the curve (AUC) value was obtained when evaluating the classifier using the Receiver Operating Characteristics (ROC) curves.

Conclusions

IR spectroscopy shows promise in its ability to differentiate epithelial misplacement from adenocarcinoma in tissue sections, considered as one of the most challenging endeavours in population-wide diagnostic histopathology. Further studies with larger series, including cases with challenging diagnostic features are required to ascertain the capability of this modern digital pathology approach. In the long-term, IR spectroscopy based pathology which is relatively low-cost and rapid, could be a promising endeavour to consider for integration into the existing histopathology pathway, in particular for population based screening programmes where large number of samples are scrutinised.

On the Limit of Detection in Infrared Spectroscopic Imaging

Infrared (IR) spectroscopic imaging instruments' performance can be characterized and optimized by an analysis of their limit of detection (LOD). Here we report a systematic analysis of the LOD for Fourier transform IR (FT-IR) and discrete frequency IR (DFIR) imaging spectrometers. In addition to traditional measurements of sample and blank data, we propose a decision theory perspective to pose the determination of LOD as a binary classification problem under different assumptions of noise uniformity and correlation. We also examine three spectral analysis approaches, namely, absorbance at a single frequency, average of absorbance over selected frequencies and total spectral distance - to suit instruments that acquire discrete or contiguous spectral bandwidths. The analysis is validated by refining the fabrication of a bovine serum albumin protein microarray to provide eight uniform spots from ∼2.8 nL of solution for each concentration over a wide range (0.05-10 mg/mL). Using scanning parameters that are typical for each instrument, we estimate a LOD of 0.16 mg/mL and 0.12 mg/mL for widefield and line scanning FT-IR imaging systems, respectively, using the spectral distance approach, and 0.22 mg/mL and 0.15 mg/mL using an optimal set of discrete frequencies. As expected, averaging and the use of post-processing techniques such as minimum noise fraction transformation results in LODs as low as ∼0.075 mg/mL that correspond to a spotted protein mass of ∼112 fg/pixel. We emphasize that these measurements were conducted at typical imaging parameters for each instrument and can be improved using the usual trading rules of IR spectroscopy. This systematic analysis and methodology for determining the LOD can allow for quantitative measures of confidence in imaging an analyte's concentration and a basis for further improving IR imaging technology.

Label-Free Infrared Spectroscopic Imaging Reveals Heterogeneity of β-Sheet Aggregates in Alzheimer's Disease

The aggregation of the amyloid beta (Aβ) protein into plaques is a pathological feature of Alzheimer's disease (AD). While amyloid aggregates have been extensively studied in vitro, their structural aspects and associated chemistry in the brain are not fully understood. In this report, we demonstrate, using infrared spectroscopic imaging, that Aβ plaques exhibit significant heterogeneities in terms of their secondary structure and phospholipid content. We show that the capabilities of discrete frequency infrared imaging (DFIR) are ideally suited for characterization of amyloid deposits in brain tissues and employ DFIR to identify nonplaque β-sheet aggregates distributed throughout brain tissues. We further demonstrate that phospholipid-rich β-sheet deposits exist outside of plaques in all diseased tissues, indicating their potential clinical significance. This is the very first application of DFIR toward a characterization of protein aggregates in an AD brain and provides a rapid, label-free approach that allows us to uncover β-sheet heterogeneities in the AD, which may be significant for targeted therapeutic strategies in the future.

Exploring AdaBoost and Random Forests machine learning approaches for infrared pathology on unbalanced data sets

The use of infrared spectroscopy to augment decision-making in histopathology is a promising direction for the diagnosis of many disease types. Hyperspectral images of healthy and diseased tissue, generated by infrared spectroscopy, are used to build chemometric models that can provide objective metrics of disease state. It is important to build robust and stable models to provide confidence to the end user. The data used to develop such models can have a variety of characteristics which can pose problems to many model-building approaches. Here we have compared the performance of two machine learning algorithms - AdaBoost and Random Forests - on a variety of non-uniform data sets. Using samples of breast cancer tissue, we devised a range of training data capable of describing the problem space. Models were constructed from these training sets and their characteristics compared. In terms of separating infrared spectra of cancerous epithelium tissue from normal-associated tissue on the tissue microarray, both AdaBoost and Random Forests algorithms were shown to give excellent classification performance (over 95% accuracy) in this study. AdaBoost models were more robust when datasets with large imbalance were provided. The outcomes of this work are a measure of classification accuracy as a function of training data available, and a clear recommendation for choice of machine learning approach.

Mid-infrared multispectral confocal microscope using off-axis parabolic mirrors to study epiretinal membranes

Mid-infrared (mid-IR) multispectral microscopy, especially operating at the wavelength of 5-11 µm, is an effective tool for detecting, identifying, and quantifying the structure and composition of biological tissues. Compared with that based on the optical lens, the mid-infrared microscope composed of off-axis parabolic (OAP) mirrors is low cost, simple, and suitable for longer range of wavelength without chromatic aberrations, while keeping the optical transmission efficiency. Here we report a compact and versatile mid-infrared multispectral confocal microscope based on off-axis parabolic mirrors. We also perform numerical calculations based on the vectorial diffraction theory on OAP mirrors and analyze the typical aberrations and misalignment of the OAP-based optical system. Finally, we perform multispectral imaging of the epiretinal membrane of the human eyes with the spectrum selected according to its resonance absorption peak. The system is designed to perform multispectral or even hyperspectral imaging to identify and predict potential disease.

Design Considerations for Discrete Frequency Infrared Microscopy Systems

Discrete frequency infrared chemical imaging is transforming the practice of microspectroscopy by enabling a diversity of instrumentation and new measurement capabilities. While a variety of hardware implementations have been realized, design considerations that are unique to infrared (IR) microscopes have not yet been compiled in literature. Here, we describe the evolution of IR microscopes, provide rationales for design choices, and catalog some major considerations for each of the optical components in an imaging system. We analyze design choices that use these components to optimize performance, under their particular constraints, while providing illustrative examples. We then summarize a framework to assess the factors that determine an instrument's performance mathematically. Finally, we provide a validation approach by enumerating performance metrics that can be used to evaluate the capabilities of imaging systems or suitability for specific intended applications. Together, the presented concepts and examples should aid in understanding available instrument configurations, while guiding innovations in design of the next generation of IR chemical imaging spectrometers.

Feasibility of dual-contrast fluorescence imaging of pathological breast tissues

The combination of intravital dye, methylene blue (MB), with molecular cancer marker, pH low insertion peptide (pHLIP) conjugated with fluorescent Alexa532 (Alexa532-pHLIP), was evaluated for enhancing contrast of pathological breast tissue ex vivo. Fresh, thick breast specimens were stained sequentially with Alexa532-pHLIP and aqueous MB and imaged using dual-channel fluorescence microscopy. MB and Alexa532-pHLIP accumulated in the nuclei and cytoplasm of cancer cells, respectively. MB also stained nuclei of normal cells. Some Alexa532-pHLIP fluorescence emission was detected from connective tissue and benign cell membranes. Overall, Alexa532-pHLIP showed high affinity to cancer, while MB highlighted tissue morphology. The results indicate that MB and Alexa532-pHLIP provide complementary information and show promise for the detection of breast cancer.

Design and Engineering of Hypoxia and Acidic pH Dual-Stimuli-Responsive Intelligent Fluorescent Nanoprobe for Precise Tumor Imaging

Stimulus-responsive fluorescence imaging modality shows great promise for detection of tumor due to the advantages of high sensitivity, simplicity and noninvasiveness. However, some non-cancer regions including nodules and inflammation may also exhibit a stimulus-related characteristic, which cause the problem of nonspecific responsiveness and then cause "false positive" results for tumor recognition. Herein, hypoxia and acidic pH, two typical features strongly associated with tumor invasion, progression and metastasis in tumor microenvironment (TME), are chosen as dual stimuli to fabricate "dual lock-and-key" fluorescent nanoprobe for highly specific and precise imaging of tumor cells. Mesoporous silica coated gold nanorods (AuNR@mSiO₂ ) are employed as nanocarrier and nanoquencher to load the pH-sensitive fluorescent reporter (Rho-TP). Azobenzene (azo) which can be reduced to amines by the highly expressed azoreductase under hypoxic conditions, is elected as the effective gatekeeper for AuNR@mSiO₂ by forming complex with β-cyclodextrin polymer via host-guest interaction (azo/β-CDP). By elaborately combining the hypoxia-responsive gatekeeper and pH-responsive fluorescent signal reporter into one nanoprobe, sensitive and specific imaging of tumor cells can be realized. The fabricated dual lock-and-key fluorescent nanoprobe successfully further apply in tumor-bearing mice model, which indicate potential of early diagnosis and assessment of cancer treatment.

Intraoperative Label-Free Multimodal Nonlinear Optical Imaging for Point-of-Procedure Cancer Diagnostics

Intraoperative imaging in surgical oncology can provide information about the tumor microenvironment as well as information about the tumor margin. Visualizing microstructural features and molecular and functional dynamics may provide important diagnostic and prognostic information, especially when obtained in real-time at the point-of-procedure. A majority of current intraoperative optical techniques are based on the use of the labels, such as fluorescent dyes. However, these exogenous agents disrupt the natural microenvironment, perturb biological processes, and alter the endogenous optical signatures that cells and the microenvironment can provide. Portable nonlinear imaging systems have enabled intraoperative imaging for real-time detection and diagnosis of tissue. We review the development of a label-free multimodal nonlinear optical imaging technique that was adapted into a portable imaging system for intraoperative optical assessment of resected human breast tissue. New developments have applied this technology to assessing needle-biopsy specimens. Needle-biopsy procedures most always precede surgical resection and serve as the first sampling of suspicious masses for diagnosis. We demonstrate the diagnostic feasibility of imaging core needle-biopsy specimens during veterinary cancer surgeries. This intraoperative label-free multimodal nonlinear optical imaging technique can potentially provide a powerful tool to assist in cancer diagnosis at the point-of-procedure.

Artificially engineered antiferromagnetic nanoprobes for ultra-sensitive histopathological level magnetic resonance imaging

Histopathological level imaging in a non-invasive manner is important for clinical diagnosis, which has been a tremendous challenge for current imaging modalities. Recent development of ultra-high-field (UHF) magnetic resonance imaging (MRI) represents a large step toward this goal. Nevertheless, there is a lack of proper contrast agents that can provide superior imaging sensitivity at UHF for disease detection, because conventional contrast agents generally induce T2 decaying effects that are too strong and thus limit the imaging performance. Herein, by rationally engineering the size, spin alignment, and magnetic moment of the nanoparticles, we develop an UHF MRI-tailored ultra-sensitive antiferromagnetic nanoparticle probe (AFNP), which possesses exceptionally small magnetisation to minimize T2 decaying effect. Under the applied magnetic field of 9 T with mice dedicated hardware, the nanoprobe exhibits the ultralow r2/r1 value (~1.93), enabling the sensitive detection of microscopic primary tumours (<0.60 mm) and micrometastases (down to 0.20 mm) in mice. The sensitivity and accuracy of AFNP-enhanced UHF MRI are comparable to those of the histopathological examination, enabling the development of non-invasive visualization of previously undetectable biological entities critical to medical diagnosis and therapy.