Optical property uncertainty estimates for spatial frequency domain imaging

Tutorial on methods for estimation of optical absorption and scattering properties of tissue

Significance

The estimation of tissue optical properties using diffuse optics has found a range of applications in disease detection, therapy monitoring, and general health care. Biomarkers derived from the estimated optical absorption and scattering coefficients can reflect the underlying progression of many biological processes in tissues.

Aim

Complex light-tissue interactions make it challenging to disentangle the absorption and scattering coefficients, so dedicated measurement systems are required. We aim to help readers understand the measurement principles and practical considerations needed when choosing between different estimation methods based on diffuse optics.

Approach

The estimation methods can be categorized as: steady state, time domain, time frequency domain (FD), spatial domain, and spatial FD. The experimental measurements are coupled with models of light-tissue interactions, which enable inverse solutions for the absorption and scattering coefficients from the measured tissue reflectance and/or transmittance.

Results

The estimation of tissue optical properties has been applied to characterize a variety of ex vivo and in vivo tissues, as well as tissue-mimicking phantoms. Choosing a specific estimation method for a certain application has to trade-off its advantages and limitations.

Conclusion

Optical absorption and scattering property estimation is an increasingly important and accessible approach for medical diagnosis and health monitoring.

Designing and simulating realistic spatial frequency domain imaging systems using open-source 3D rendering software

Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that maps absorption and reduced scattering coefficients, offering improved contrast for important tissue structures such as tumours. Practical SFDI systems must cope with various imaging geometries including imaging planar samples ex vivo, imaging inside tubular lumen in vivo e.g. for endoscopy, and measuring tumours or polyps of varying morphology. There is a need for a design and simulation tool to accelerate design of new SFDI systems and simulate realistic performance under these scenarios. We present such a system implemented using open-source 3D design and ray-tracing software Blender that simulates media with realistic absorption and scattering in a wide range of geometries. By using Blender's Cycles ray-tracing engine, our system simulates effects such as varying lighting, refractive index changes, non-normal incidence, specular reflections and shadows, enabling realistic evaluation of new designs. We first demonstrate quantitative agreement between Monte-Carlo simulated absorption and reduced scattering coefficients with those simulated from our Blender system, achieving 16 % discrepancy in absorption coefficient and 18 % in reduced scattering coefficient. However, we then show that using an empirically derived look-up table the errors reduce to 1 % and 0.7 % respectively. Next, we simulate SFDI mapping of absorption, scattering and shape for simulated tumour spheroids, demonstrating enhanced contrast. Finally we demonstrate SFDI mapping inside a tubular lumen, which highlighted a important design insight: custom look-up tables must be generated for different longitudinal sections of the lumen. With this approach we achieved 2 % absorption error and 2 % scattering error. We anticipate our simulation system will aid in the design of novel SFDI systems for key biomedical applications.

Extracting Tissue Optical Properties and Detecting Bruised Tissue in Pears Quickly and Accurately Based on Spatial Frequency Domain Imaging and Machine Learning

Recently, Spatial Frequency Domain Imaging (SFDI) has gradually become an alternative method to extract tissue optical properties (OPs), as it provides a wide-field, no-contact acquisition. SFDI extracts OPs by least-square fitting (LSF) based on the diffuse approximation equation, but there are shortcomings in the speed and accuracy of extracting OPs. This study proposed a Long Short-term Memory Regressor (LSTMR) solution to extract tissue OPs. This method allows for fast and accurate extraction of tissue OPs. Firstly, the imaging system was developed, which is more compact and portable than conventional SFDI systems. Next, numerical simulation was performed using the Monte Carlo forward model to obtain the dataset, and then the mapping model was established using the dataset. Finally, the model was applied to detect the bruised tissue of 'crown' pears. The results show that the mean absolute errors of the absorption coefficient and the reduced scattering coefficient are no more than 0.32% and 0.21%, and the bruised tissue of 'crown' pears can be highlighted by the change of OPs. Compared with the LSF, the speed of extracting tissue OPs is improved by two orders of magnitude, and the accuracy is greatly improved. The study contributes to the rapid and accurate extraction of tissue OPs based on SFDI and has great potential in food safety assessment.

Visible near-infrared hyperspectral imaging and supervised classification for the detection of small intestinal necrosis tissue in vivo

Complete recognition of necrotic areas during small bowel tissue resection remains challenging due to the lack of optimal intraoperative aid identification techniques. This research utilizes hyperspectral imaging techniques to automatically distinguish normal and necrotic areas of small intestinal tissue. Sample data were obtained from the animal model of small intestinal tissue of eight Japanese large-eared white rabbits developed by experienced physicians. A spectral library of normal and necrotic regions of small intestinal tissue was created and processed using six different supervised classification algorithms. The results show that hyperspectral imaging combined with supervised classification algorithms can be a suitable technique to automatically distinguish between normal and necrotic areas of small intestinal tissue. This new technique could aid physicians in objectively identify normal and necrotic areas of small intestinal tissue.

Quantitative spatial mapping of tissue water and lipid content using spatial frequency domain imaging in the 900- to 1000-nm wavelength region

SIGNIFICANCE

Water and lipid are key participants of many biological processes, but there are few label-free, non-contact optical methods that can spatially map these components in-vivo. Shortwave infrared meso-patterned imaging (SWIR-MPI) is an emerging technique that successfully addresses this need. However, it requires a dedicated SWIR camera to probe the 900- to 1300-nm wavelength region, which hinders practical translation of the technology.

AIM

Compared with SWIR-MPI, we aim to develop a new technique that can dramatically reduce the cost in detector while maintaining high accuracy for the quantification of tissue water and lipid content.

APPROACH

By utilizing water and lipid absorption features in the 900- to 1000-nm wavelength region as well as optimal wavelength and spatial frequency combinations, we develop a new imaging technique based on spatial frequency domain imaging to quantitatively map tissue water and lipid content using a regular silicon-based camera.

RESULTS

The proposed method is validated with a phantom study, which shows average error of 0.9 ± 1.2 % for water content estimation, and -0.4 ± 0.7 % for lipid content estimation, respectively. The proposed method is also demonstrated for ex vivo porcine tissue lipid mapping as well as in-vivo longitudinal water content monitoring.

CONCLUSIONS

The proposed technique enables spatial mapping of tissue water and lipid content with the cost in detector reduced by two orders of magnitude compared with SWIR-MPI while maintaining high accuracy. The experimental results highlight the potential of this technique for substantial impact in both scientific and industrial applications.

Wavelength and frequency optimization in spatial frequency domain imaging for two-layer tissue

Spatial frequency domain imaging is a non-contact, wide-field, fast-diffusion optical imaging technique, which in principle uses steady-state spatially modulated light to irradiate biological tissue, reconstruct two-dimensional or three-dimensional tissue optical characteristic map through optical transmission model, and further quantify the spatial distribution of tissue physiological parameters by multispectral imaging technique. The selection of light source wavelength and light field spatial modulation frequency is directly related to the accuracy of tissue optical properties and tissue physiological parameters extraction. For improvement of the measurement accuracy of optical properties and physiological parameters in the two-layer tissue, a multispectral spatial frequency domain imaging system is built based on liquid crystal tunable filter, and a data mapping table of spatially resolved diffuse reflectance and optical properties of two-layer tissue is established based on scaling Monte Carlo method. Combined with the dispersion effect and window effect of light-tissue interaction, the study applies numerical simulation to optimize the wavelength in the 650-850 nm range with spectral resolution of 10 nm. In order to minimize the uncertainty of the optical properties, Cramér-Rao bound is used to optimize the optical field spatial modulation frequency by transmitting the uncertainty of optical properties. The results showed that in order to realize the detection of melanin, oxyhemoglobin, deoxyhemoglobin, water and other physiological parameters in two-layer tissue, the best wavelength combination was determined as 720, 730, 760 and 810 nm according to the condition number. The findings of the Cramér-Rao bound analysis reveal that the uncertainty of optical characteristics for the frequency combinations [0, 0.3] mm^-1, [0, 0.2] mm^-1, and [0, 0.1] mm^-1 increases successively. Under the optimal combination of wavelength and frequency, the diffuse reflectance of the gradient gray-scale plate measured by the multi-spectral spatial frequency domain imaging system is linearly correlated with the calibration value. The error between the measured liquid phantom absorption coefficient and the collimation projection system based on colorimetric dish is less than 2%. The experimental results of human brachial artery occlusion indicate that under the optimal wavelength combination, the change of the second layer absorption coefficient captured by the three frequency combinations decreases in turn, so as the change of oxygen saturation.

Shortwave infrared spatial frequency domain imaging for non-invasive measurement of tissue and blood optical properties

SIGNIFICANCE

The shortwave infrared (SWIR) optical window (∼900 to 2000 nm) has attracted interest for deep tissue imaging due to the lower scattering of light. SWIR spatial frequency domain imaging (SWIR SFDI) provides wide-field tissue optical property measurements in this wavelength band. Key design and performance characteristics, such as portability, wavelength selection, measurement resolution, and the effect of skin have not yet been addressed for SWIR SFDI.

AIM

To fabricate and characterize a SWIR SFDI system for clinical use.

APPROACH

The optimal choice of wavelengths was identified based on optical property uncertainty estimates and imaging depth. A compact light-emitting diode-based dual wavelength SWIR SFDI system was fabricated. A two-layer inverse model was developed to account for the layered structure of skin. Performance was validated using tissue-simulating phantoms and in-vivo measurements from three healthy subjects.

RESULTS

The SWIR SFDI system had a μs' resolution of at least 0.03  mm  -  1 at 880 nm and 0.02  mm  -  1 at 1100 nm. The two-layer inverse model reduced the error in deeper layer μs' extractions by at least 24% in the phantom study. The two-layer model also increased the contrast between superficial vessels and the surrounding tissue for in-vivo measurements.

CONCLUSION

The clinic-ready SWIR SFDI device is sensitive to small optical property alterations in diffuse media, provides enhanced accuracy in quantifying optical properties in the deeper layers in phantoms, and provided enhanced contrast of subcutaneous blood vessels.

Ultracompact Deep Neural Network for Ultrafast Optical Property Extraction in Spatial Frequency Domain Imaging (SFDI)

Spatial frequency domain imaging (SFDI) is a powerful, label-free imaging technique capable of the wide-field quantitative mapping of tissue optical properties and, subsequently, chromophore concentrations. While SFDI hardware acquisition methods have advanced towards video-rate, the inverse problem (i.e., the mapping of acquired diffuse reflectance to optical properties) has remained a bottleneck for real-time data processing and visualization. Deep learning methods are adept at fitting nonlinear patterns, and may be ideal for rapidly solving the SFDI inverse problem. While current deep neural networks (DNN) are growing increasingly larger and more complex (e.g., with millions of parameters or more), our study shows that it can also be beneficial to move in the other direction, i.e., make DNNs that are smaller and simpler. Here, we propose an ultracompact, two-layer, fully connected DNN structure (each layer with four and two neurons, respectively) for ultrafast optical property extractions, which is 30×–600× faster than current methods with a similar or improved accuracy, allowing for an inversion time of 5.5 ms for 696 × 520 pixels. We further demonstrated the proposed inverse model in numerical simulations, and comprehensive phantom characterization, as well as offering in vivo measurements of dynamic physiological processes. We further demonstrated that the computation time could achieve another 200× improvement with a GPU device. This deep learning structure will help to enable fast and accurate real-time SFDI measurements, which are crucial for pre-clinical, clinical, and industrial applications.

Halftone spatial frequency domain imaging enables kilohertz high-speed label-free non-contact quantitative mapping of optical properties for strongly turbid media

The ability to quantify optical properties (i.e., absorption and scattering) of strongly turbid media has major implications on the characterization of biological tissues, fluid fields, and many others. However, there are few methods that can provide wide-field quantification of optical properties, and none is able to perform quantitative optical property imaging with high-speed (e.g., kilohertz) capabilities. Here we develop a new imaging modality termed halftone spatial frequency domain imaging (halftone-SFDI), which is approximately two orders of magnitude faster than the state-of-the-art, and provides kilohertz high-speed, label-free, non-contact, wide-field quantification for the optical properties of strongly turbid media. This method utilizes halftone binary patterned illumination to target the spatial frequency response of turbid media, which is then mapped to optical properties using model-based analysis. We validate the halftone-SFDI on an array of phantoms with a wide range of optical properties as well as in vivo human tissue. We demonstrate with an in vivo rat brain cortex imaging study, and show that halftone-SFDI can longitudinally monitor the absolute concentration as well as spatial distribution of functional chromophores in tissue. We also show that halftone-SFDI can spatially map dual-wavelength optical properties of a highly dynamic flow field at kilohertz speed. Together, these results highlight the potential of halftone-SFDI to enable new capabilities in fundamental research and translational studies including brain science and fluid dynamics.

Simple demodulation method for optical property extraction in spatial frequency domain imaging

Different demodulation methods affect the efficiency and accuracy of spatial frequency domain imaging (SFDI). A simple and effective method of sum-to-product identities (STPI) demodulation was proposed in this study. STPI requires one fewer image than conventional three-phase demodulation (TPD) at a spatial frequency. Numerical simulation and phantom experiments were performed. The result proved the feasibility of STPI and showed that STPI combined with subtraction can achieve high-precision demodulation in the low spatial frequency domain. Through extraction of phantom optical properties, STPI had similar accuracy compared with other demodulation methods in extracting optical properties in phantoms. STPI was also used to extract the optical properties of milk, and it had highly consistent results with TPD, which can distinguish milk with different fat content. The demodulation effect of this method in the low spatial frequencies is better than other fast demodulation methods.

Modeling and Synthesis of Breast Cancer Optical Property Signatures With Generative Models

Is it possible to find deterministic relationships between optical measurements and pathophysiology in an unsupervised manner and based on data alone? Optical property quantification is a rapidly growing biomedical imaging technique for characterizing biological tissues that shows promise in a range of clinical applications, such as intraoperative breast-conserving surgery margin assessment. However, translating tissue optical properties to clinical pathology information is still a cumbersome problem due to, amongst other things, inter- and intrapatient variability, calibration, and ultimately the nonlinear behavior of light in turbid media. These challenges limit the ability of standard statistical methods to generate a simple model of pathology, requiring more advanced algorithms. We present a data-driven, nonlinear model of breast cancer pathology for real-time margin assessment of resected samples using optical properties derived from spatial frequency domain imaging data. A series of deep neural network models are employed to obtain sets of latent embeddings that relate optical data signatures to the underlying tissue pathology in a tractable manner. These self-explanatory models can translate absorption and scattering properties measured from pathology, while also being able to synthesize new data. The method was tested on a total of 70 resected breast tissue samples containing 137 regions of interest, achieving rapid optical property modeling with errors only limited by current semi-empirical models, allowing for mass sample synthesis and providing a systematic understanding of dataset properties, paving the way for deep automated margin assessment algorithms using structured light imaging or, in principle, any other optical imaging technique seeking modeling. Code is available.

Two-layer spatial frequency domain imaging of compression-induced hemodynamic changes in breast tissue

Significance: Longitudinal tracking of hemodynamic changes in the breast has shown potential for neoadjuvant chemotherapy (NAC) outcome prediction. Spatial frequency domain imaging (SFDI) could be suitable for frequent monitoring of shallow breast tumors, but strong sensitivity to superficial absorbers presents a challenge.

Aim: We investigated the efficacy of a two-layer SFDI inverse model that accounts for varying melanin concentration in the skin to improve discrimination of optical properties of deep tissue of the breast.

Approach: Hemodynamic changes in response to localized breast compression were measured in 13 healthy volunteers using a handheld SFDI device. Epidermis optical thickness was determined based on spectral fitting of the model output and used to calculate subcutaneous optical properties.

Results: Optical properties from a homogeneous model yielded physiologically unreasonable absorption and scattering coefficients for highly pigmented volunteers. The two-layer model compensated for the effect of melanin and yielded properties in the expected range for healthy breast. Extracted epidermal optical thickness was higher for higher Fitzpatrick types. Compression induced a decrease in total hemoglobin consistent with tissue blanching.

Conclusions: The handheld SFDI device and two-layer model show potential for imaging hemodynamic responses that potentially could help predict efficacy of NAC in patients of varying skin tones.

Speckle illumination SFDI for projector-free optical property mapping

Spatial frequency domain imaging can map tissue scattering and absorption properties over a wide field of view, making it useful for clinical applications such as wound assessment and surgical guidance. This technique has previously required the projection of fully characterized illumination patterns. Here, we show that random and unknown speckle illumination can be used to sample the modulation transfer function of tissues at known spatial frequencies, allowing the quantitative mapping of optical properties with simple laser diode illumination. We compute low- and high-spatial frequency response parameters from the local power spectral density for each pixel and use a lookup table to accurately estimate absorption and scattering coefficients in tissue phantoms, in vivo human hand, and ex vivo swine esophagus. Because speckle patterns can be generated over a large depth of field and field of view with simple coherent illumination, this approach may enable optical property mapping in new form-factors and applications, including endoscopy.

Direct mapping from diffuse reflectance to chromophore concentrations in multi-fx spatial frequency domain imaging (SFDI) with a deep residual network (DRN)

Spatial frequency domain imaging (SFDI) is an emerging technology that enables label-free, non-contact, and wide-field mapping of tissue chromophore contents, such as oxy- and deoxy-hemoglobin concentrations. It has been shown that the use of more than two spatial frequencies (multi-fx ) can vastly improve measurement accuracy and reduce chromophore estimation uncertainties, but real-time multi-fx SFDI for chromophore monitoring has been limited in practice due to the slow speed of available chromophore inversion algorithms. Existing inversion algorithms have to first convert the multi-fx diffuse reflectance to optical absorptions, and then solve a set of linear equations to estimate chromophore concentrations. In this work, we present a deep learning framework, noted as a deep residual network (DRN), that is able to directly map from diffuse reflectance to chromophore concentrations. The proposed DRN is over 10x faster than the state-of-the-art method for chromophore inversion and enables 25x improvement on the frame rate for in vivo real-time oxygenation mapping. The proposed deep learning model will help enable real-time and highly accurate chromophore monitoring with multi-fx SFDI.

Shortwave-infrared meso-patterned imaging enables label-free mapping of tissue water and lipid content

Water and lipids are key participants in many biological processes, but there are few non-invasive methods that provide quantification of these components in vivo, and none that can isolate and quantify lipids in the blood. Here we develop a new imaging modality termed shortwave infrared meso-patterned imaging (SWIR-MPI) to provide label-free, non-contact, spatial mapping of water and lipid concentrations in tissue. The method utilizes patterned hyperspectral illumination to target chromophore absorption bands in the 900-1,300 nm wavelength range. We use SWIR-MPI to monitor clinically important physiological processes including edema, inflammation, and tumor lipid heterogeneity in preclinical models. We also show that SWIR-MPI can spatially map blood-lipids in humans, representing an example of non-invasive and contact-free measurements of in vivo blood lipids. Together, these results highlight the potential of SWIR-MPI to enable new capabilities in fundamental studies and clinical monitoring of major conditions including obesity, cancer, and cardiovascular disease.

JP, Austin W, Tabassum SM, Aguénounon E, Tilbury K, Saager RB, Gioux S, Roblyer D. OpenSFDI: an open-source guide for constructing a spatial frequency domain imaging system

Significance: Spatial frequency domain imaging (SFDI) is a diffuse optical measurement technique that can quantify tissue optical absorption (μ_a) and reduced scattering (<inline-formula>μs'</inline-formula>) on a pixel-by-pixel basis. Measurements of μ_a at different wavelengths enable the extraction of molar concentrations of tissue chromophores over a wide field, providing a noncontact and label-free means to assess tissue viability, oxygenation, microarchitecture, and molecular content. We present here openSFDI: an open-source guide for building a low-cost, small-footprint, three-wavelength SFDI system capable of quantifying μ_a and <inline-formula>μs'</inline-formula> as well as oxyhemoglobin and deoxyhemoglobin concentrations in biological tissue. The companion website provides a complete parts list along with detailed instructions for assembling the openSFDI system.<p> Aim: We describe the design of openSFDI and report on the accuracy and precision of optical property extractions for three different systems fabricated according to the instructions on the openSFDI website.</p> <p> Approach: Accuracy was assessed by measuring nine tissue-simulating optical phantoms with a physiologically relevant range of μ_a and <inline-formula>μs'</inline-formula> with the openSFDI systems and a commercial SFDI device. Precision was assessed by repeatedly measuring the same phantom over 1 h.</p> <p> Results: The openSFDI systems had an error of 0  ±  6  %   in μ_a and -2  ±  3  %   in <inline-formula>μs'</inline-formula>, compared to a commercial SFDI system. Bland-Altman analysis revealed the limits of agreement between the two systems to be   ±  0.004  mm^-  1 for μ_a and -0.06 to 0.1  mm^-  1 for <inline-formula>μs'</inline-formula>. The openSFDI system had low drift with an average standard deviation of 0.0007  mm^-  1 and 0.05  mm^-  1 in μ_a and <inline-formula>μs'</inline-formula>, respectively.</p>,<p> Conclusion: The openSFDI provides a customizable hardware platform for research groups seeking to utilize SFDI for quantitative diffuse optical imaging.</p>

Optical sampling depth in the spatial frequency domain

We present a Monte Carlo (MC) method to determine depth-dependent probability distributions of photon visitation and detection for optical reflectance measurements performed in the spatial frequency domain (SFD). These distributions are formed using an MC simulation for radiative transport that utilizes a photon packet weighting procedure consistent with the two-dimensional spatial Fourier transform of the radiative transport equation. This method enables the development of quantitative metrics for SFD optical sampling depth in layered tissue and its dependence on both tissue optical properties and spatial frequency. We validate the computed depth-dependent probability distributions using SFD measurements in a layered phantom system with a highly scattering top layer of variable thickness supported by a highly absorbing base layer. We utilize our method to establish the spatial frequency-dependent optical sampling depth for a number of tissue types and also provide a general tool to determine such depths for tissues of arbitrary optical properties.

Diffuse and nonlinear imaging of multiscale vascular parameters for in vivo monitoring of preclinical mammary tumors

Diffuse optical imaging (DOI) techniques provide a wide-field or macro assessment of the functional tumor state and have shown substantial promise for monitoring treatment efficacy in cancer. Conversely, intravital microscopy provides a high-resolution view of the tumor state and has played a key role in characterizing treatment response in the preclinical setting. There has been little prior work in investigating how the macro and micro spatial scales can be combined to develop a more comprehensive and translational view of treatment response. To address this, a new multiscale preclinical imaging technique called diffuse and nonlinear imaging (DNI) was developed. DNI combines multiphoton microscopy with spatial frequency domain imaging (SFDI) to provide multiscale data sets of tumor microvascular architecture coregistered within wide-field hemodynamic maps. A novel method was developed to match the imaging depths of both modalities by utilizing informed SFDI spatial frequency selection. An in vivo DNI study of murine mammary tumors revealed multiscale relationships between tumor oxygen saturation and microvessel diameter, and tumor oxygen saturation and microvessel length (|Pearson's ρ| ≥ 0.5, P < 0.05). Going forward, DNI will be uniquely enabling for the investigation of multiscale relationships in tumors during treatment.

Spatial frequency domain imaging in 2019: principles, applications, and perspectives

Spatial frequency domain imaging (SFDI) has witnessed very rapid growth over the last decade, owing to its unique capabilities for imaging optical properties and chromophores over a large field-of-view and in a rapid manner. We provide a comprehensive review of the principles of this imaging method as of 2019, review the modeling of light propagation in this domain, describe acquisition methods, provide an understanding of the various implementations and their practical limitations, and finally review applications that have been published in the literature. Importantly, we also introduce a group effort by several key actors in the field for the dissemination of SFDI, including publications, advice in hardware and implementations, and processing code, all freely available online.

Spatial frequency domain imaging in 2019: principles, applications, and perspectives

Spatial frequency domain imaging (SFDI) has witnessed very rapid growth over the last decade, owing to its unique capabilities for imaging optical properties and chromophores over a large field-of-view and in a rapid manner. We provide a comprehensive review of the principles of this imaging method as of 2019, review the modeling of light propagation in this domain, describe acquisition methods, provide an understanding of the various implementations and their practical limitations, and finally review applications that have been published in the literature. Importantly, we also introduce a group effort by several key actors in the field for the dissemination of SFDI, including publications, advice in hardware and implementations, and processing code, all freely available online.

Microvascular imaging of the skin

Despite our understanding that the microvasculature plays a multifaceted role in the development and progression of various conditions, we know little about the extent of this involvement. A need exists for non-invasive, clinically meaningful imaging modalities capable of elucidating microvascular information to aid in our understanding of disease, and to aid in the diagnosis/monitoring of disease for more patient-specific care. In this review article, a number of imaging techniques are summarized that have been utilized to investigate the microvasculature of skin, along with their advantages, disadvantages and future perspectives in preclinical and clinical settings. These techniques include dermoscopy, capillaroscopy, Doppler sonography, laser Doppler flowmetry (LDF) and perfusion imaging, laser speckle contrast imaging (LSCI), optical coherence tomography (OCT), including its Doppler and dynamic variant and the more recently developed OCT angiography (OCTA), photoacoustic imaging, and spatial frequency domain imaging (SFDI). Attention is largely, but not exclusively, placed on optical imaging modalities that use intrinsic optical signals to contrast the microvasculature. We conclude that whilst each imaging modality has been successful in filling a particular niche, there is no one, all-encompassing modality without inherent flaws. Therefore, the future of cutaneous microvascular imaging may lie in utilizing a multi-modal approach that will counter the disadvantages of individual systems to synergistically augment our imaging capabilities.

Quantitative real-time pulse oximetry with ultrafast frequency-domain diffuse optics and deep neural network processing

Pulse oximetry is a ubiquitous optical technology, widely used for diagnosis and treatment guidance. Current pulse oximeters provide indications of arterial oxygen saturation. We present here a new quantitative methodology that extends the capability of pulse oximetry and provides real-time molar concentrations of oxy- and deoxy-hemoglobin at rates of up to 27 Hz by using advanced digital hardware, real-time firmware processing, and ultra-fast optical property calculations with a deep neural network (DNN). The technique utilizes a high-speed frequency domain spectroscopy system with five frequency-multiplexed wavelengths. High-speed demultiplexing and data reduction were performed in firmware. The DNN inversion algorithm was benchmarked as five orders of magnitude faster than conventional iterative methods for optical property extractions. The DNN provided unbiased optical property extractions, with an average error of 0 ± 5.6% in absorption and 0 ± 1.4% in reduced scattering. Together, these improvements enabled the measurement, calculation, and real-time continuous display of hemoglobin concentrations. A proof-of-concept cuff occlusion measurement was performed to demonstrate the ability of the device to track oxy- and deoxy-hemoglobin, and measure quantitative photoplethysmographic changes during the cardiac cycle. This technique substantially extends the capability of pulse oximetry and provides unprecedented real-time non-invasive functional information with broad applicability for cardiopulmonary applications.

Deep learning model for ultrafast multifrequency optical property extractions for spatial frequency domain imaging

Spatial frequency domain imaging (SFDI) is emerging as an important new method in biomedical imaging due to its ability to provide label-free, wide-field tissue optical property maps. Most prior SFDI studies have utilized two spatial frequencies (2-f_x) for optical property extractions. The use of more than two frequencies (multi-f_x) can vastly improve the accuracy and reduce uncertainties in optical property estimates for some tissue types, but it has been limited in practice due to the slow speed of available inversion algorithms. We present a deep learning solution that eliminates this bottleneck by solving the multi-f_x inverse problem 300× to 100,000× faster, with equivalent or improved accuracy compared to competing methods. The proposed deep learning inverse model will help to enable real-time and highly accurate tissue measurements with SFDI.

Review of structured light in diffuse optical imaging

Diffuse optical imaging probes deep living tissue enabling structural, functional, metabolic, and molecular imaging. Recently, due to the availability of spatial light modulators, wide-field quantitative diffuse optical techniques have been implemented, which benefit greatly from structured light methodologies. Such implementations facilitate the quantification and characterization of depth-resolved optical and physiological properties of thick and deep tissue at fast acquisition speeds. We summarize the current state of work and applications in the three main techniques leveraging structured light: spatial frequency-domain imaging, optical tomography, and single-pixel imaging. The theory, measurement, and analysis of spatial frequency-domain imaging are described. Then, advanced theories, processing, and imaging systems are summarized. Preclinical and clinical applications on physiological measurements for guidance and diagnosis are summarized. General theory and method development of tomographic approaches as well as applications including fluorescence molecular tomography are introduced. Lastly, recent developments of single-pixel imaging methodologies and applications are reviewed.