Separating melanin from hemodynamics in nevi using multimode hyperspectral dermoscopy and spatial frequency domain spectroscopy

Investigation on the influence of the skin tone on hyperspectral imaging for free flap surgery

Hyperspectral imaging (HSI) is a new emerging modality useful for the noncontact assessment of free flap perfusion. This measurement technique relies on the optical properties within the tissue. Since the optical properties of hemoglobin (Hb) and melanin overlap, the results of the perfusion assessment and other tissue-specific parameters are likely to be distorted by the melanin, especially at higher melanin concentrations. Many spectroscopic devices have been shown to struggle with a melanin related bias, which results in a clinical need to improve non-invasive perfusion assessment, especially for a more pigmented population. This study investigated the influence of skin tones on tissue indices measurements using HSI. In addition, other factors that might affect HSI, such as age, body mass index (BMI), sex or smoking habits, were also considered. Therefore, a prospective feasibility study was conducted, including 101 volunteers from whom tissue indices measurements were performed on 16 different body sites. Skin tone classification was performed using the Fitzpatrick skin type classification questionnaire, and the individual typology angle (ITA) acquired from the RGB images was calculated simultaneously with the measurements. Tissue indices provided by the used HSI-device were correlated to the possible influencing factors. The results show that a dark skin tone and, therefore, higher levels of pigmentation influence the HSI-derived tissue indices. In addition, possible physiological factors influencing the HSI-measurements were found. In conclusion, the HSI-based tissue indices can be used for perfusion assessment for people with lighter skin tone levels but show limitations in people with darker skin tones. Furthermore, it could be used for a more individual perfusion assessment if different physiological influencing factors are respected.

Wavelength and frequency optimization in spatial frequency domain imaging for two-layer tissue

Spatial frequency domain imaging is a non-contact, wide-field, fast-diffusion optical imaging technique, which in principle uses steady-state spatially modulated light to irradiate biological tissue, reconstruct two-dimensional or three-dimensional tissue optical characteristic map through optical transmission model, and further quantify the spatial distribution of tissue physiological parameters by multispectral imaging technique. The selection of light source wavelength and light field spatial modulation frequency is directly related to the accuracy of tissue optical properties and tissue physiological parameters extraction. For improvement of the measurement accuracy of optical properties and physiological parameters in the two-layer tissue, a multispectral spatial frequency domain imaging system is built based on liquid crystal tunable filter, and a data mapping table of spatially resolved diffuse reflectance and optical properties of two-layer tissue is established based on scaling Monte Carlo method. Combined with the dispersion effect and window effect of light-tissue interaction, the study applies numerical simulation to optimize the wavelength in the 650-850 nm range with spectral resolution of 10 nm. In order to minimize the uncertainty of the optical properties, Cramér-Rao bound is used to optimize the optical field spatial modulation frequency by transmitting the uncertainty of optical properties. The results showed that in order to realize the detection of melanin, oxyhemoglobin, deoxyhemoglobin, water and other physiological parameters in two-layer tissue, the best wavelength combination was determined as 720, 730, 760 and 810 nm according to the condition number. The findings of the Cramér-Rao bound analysis reveal that the uncertainty of optical characteristics for the frequency combinations [0, 0.3] mm^-1, [0, 0.2] mm^-1, and [0, 0.1] mm^-1 increases successively. Under the optimal combination of wavelength and frequency, the diffuse reflectance of the gradient gray-scale plate measured by the multi-spectral spatial frequency domain imaging system is linearly correlated with the calibration value. The error between the measured liquid phantom absorption coefficient and the collimation projection system based on colorimetric dish is less than 2%. The experimental results of human brachial artery occlusion indicate that under the optimal wavelength combination, the change of the second layer absorption coefficient captured by the three frequency combinations decreases in turn, so as the change of oxygen saturation.

Quantifying the confounding effect of pigmentation on measured skin tissue optical properties: a comparison of colorimetry with spatial frequency domain imaging

SIGNIFICANCE

Spatial frequency domain imaging (SFDI) is a wide-field diffuse optical imaging technique for separately quantifying tissue reduced scattering (μs  '  ) and absorption (μa) coefficients at multiple wavelengths, providing wide potential utility for clinical applications such as burn wound characterization and cancer detection. However, measured μs  '   and μa can be confounded by absorption from melanin in patients with highly pigmented skin. This issue arises because epidermal melanin is highly absorbing for visible wavelengths and standard homogeneous light-tissue interaction models do not properly account for this complexity. Tristimulus colorimetry (which quantifies pigmentation using the L  *   "lightness" parameter) can provide a point of comparison between μa, μs  '  , and skin pigmentation.

AIM

We systematically compare SFDI and colorimetry parameters to quantify confounding effects of pigmentation on measured skin μs  '   and μa. We assess the correlation between SFDI and colorimetry parameters as a function of wavelength.

APPROACH

μs  '   and μa from the palm and ventral forearm were measured for 15 healthy subjects with a wide range of skin pigmentation levels (Fitzpatrick types I to VI) using a Reflect RS® (Modulim, Inc., Irvine, California) SFDI instrument (eight wavelengths, 471 to 851 nm). L  *   was measured using a Chroma Meter CR-400 (Konica Minolta Sensing, Inc., Tokyo). Linear correlation coefficients were calculated between L  *   and μs  '   and between L  *   and μa at all wavelengths.

RESULTS

For the ventral forearm, strong linear correlations between measured L  *   and μs  '   values were observed at shorter wavelengths (R  >  0.92 at ≤659  nm), where absorption from melanin confounded the measured μs  '  . These correlations were weaker for the palm (R  <  0.59 at ≤659  nm), which has less melanin than the forearm. Similar relationships were observed between L  *   and μa.

CONCLUSIONS

We quantified the effects of epidermal melanin on skin μs  '   and μa measured with SFDI. This information may help characterize and correct pigmentation-related inaccuracies in SFDI skin measurements.

Biomedical Applications of Translational Optical Imaging: From Molecules to Humans

Light is a powerful investigational tool in biomedicine, at all levels of structural organization. Its multitude of features (intensity, wavelength, polarization, interference, coherence, timing, non-linear absorption, and even interactions with itself) able to create contrast, and thus images that detail the makeup and functioning of the living state can and should be combined for maximum effect, especially if one seeks simultaneously high spatiotemporal resolution and discrimination ability within a living organism. The resulting high relevance should be directed towards a better understanding, detection of abnormalities, and ultimately cogent, precise, and effective intervention. The new optical methods and their combinations needed to address modern surgery in the operating room of the future, and major diseases such as cancer and neurodegeneration are reviewed here, with emphasis on our own work and highlighting selected applications focusing on quantitation, early detection, treatment assessment, and clinical relevance, and more generally matching the quality of the optical detection approach to the complexity of the disease. This should provide guidance for future advanced theranostics, emphasizing a tighter coupling-spatially and temporally-between detection, diagnosis, and treatment, in the hope that technologic sophistication such as that of a Mars rover can be translationally deployed in the clinic, for saving and improving lives.

Light- and Melanin Nanoparticle-Induced Cytotoxicity in Metastatic Cancer Cells

Melanin nanoparticles are known to be biologically benign to human cells for a wide range of concentrations in a high glucose culture nutrition. Here, we show cytotoxic behavior at high nanoparticle and low glucose concentrations, as well as at low nanoparticle concentration under exposure to (nonionizing) visible radiation. To study these effects in detail, we developed highly monodispersed melanin nanoparticles (both uncoated and glucose-coated). In order to study the effect of significant cellular uptake of these nanoparticles, we employed three cancer cell lines: VM-M3, A375 (derived from melanoma), and HeLa, all known to exhibit strong macrophagic character, i.e., strong nanoparticle uptake through phagocytic ingestion. Our main observations are: (i) metastatic VM-M3 cancer cells massively ingest melanin nanoparticles (mNPs); (ii) the observed ingestion is enhanced by coating mNPs with glucose; (iii) after a certain level of mNP ingestion, the metastatic cancer cells studied here are observed to die—glucose coating appears to slow that process; (iv) cells that accumulate mNPs are much more susceptible to killing by laser illumination than cells that do not accumulate mNPs; and (v) non-metastatic VM-NM1 cancer cells also studied in this work do not ingest the mNPs, and remain unaffected after receiving identical optical energy levels and doses. Results of this study could lead to the development of a therapy for control of metastatic stages of cancer.

Dual-DMD hyperspectral spatial frequency domain imaging (SFDI) using dispersed broadband illumination with a demonstration of blood stain spectral monitoring

Spatial frequency domain imaging (SFDI) is a widefield diffuse optical measurement technique capable of generating 2D maps of sub-surface absorption and scattering in biological tissue. We developed a new hyperspectral SFDI instrument capable of collecting images at wavelengths from the visible to the near infrared. The system utilizes a custom-built monochromator with a digital micromirror device (DMD) that can dynamically select illumination wavelength bands from a broadband quartz tungsten halogen lamp, and a second DMD to provide spatially modulated sample illumination. The system is capable of imaging 10 wavelength bands in approximately 25 seconds. The spectral resolution can be varied from 12 to 30 nm by tuning the input slit width and the output DMD column width. We compared the optical property extraction accuracy between the new device and a commercial SFDI system and found an average error of 23% in absorption and 6% in scattering. The system was highly stable, with less than 5% variation in absorption and less than 0.2% variation in scattering across all wavelengths over two hours. The system was used to monitor hyperspectral changes in the optical absorption and reduced scattering spectra of blood exposed to air over 24 hours. This served as a general demonstration of the utility of this system, and points to a potential application for blood stain age estimation. We noted significant changes in both absorption and reduced scattering spectra over multiple discrete stages of aging. To our knowledge, these are the first measurement of changes in scattering of blood stains. This hyperspectral SFDI system holds promise for a multitude of applications in quantitative tissue and diffuse sample imaging.

Enhanced visualization of blood and pigment in multispectral skin dermoscopy

BACKGROUND AND OBJECTIVES

Dermoscopy has proven its value in the diagnosis of skin cancer and, therefore, is well established in daily dermatology practice. Up until now, analogue white light dermoscopy is the standard. Multispectral dermoscopy is based on illumination of the skin with narrowband light sources with different wavelengths. Each of these wavelengths is differently absorbed by skin chromophores, such as pigment or (de)oxygenated blood. Multispectral dermoscopy could be a way to enhance the visualization of vasculature and pigment. We illustrate possible additional information by such "skin parameter maps" in some cases of basal cell carcinoma and Bowen's disease.

METHODS

Using a new digital multispectral dermatoscope, skin images at multiple wavelengths are collected from different types of skin lesions. These particular images together with the knowledge on skin absorption properties, result in so called "skin parameter maps".

RESULTS

A "pigment contrast map," which shows the relative concentration of primarily pigment, and a "blood contrast map" which shows the relative concentration of primarily blood were created. Especially, the latter is of importance in diagnosing keratinocyte skin cancer hence vascular structures are a characteristic feature, as further illustrated in the study.

CONCLUSIONS

Skin parameter maps based on multispectral images can give better insight in the inner structures of lesions, especially in lesions with characteristic blood vessels such as Bowen's disease and basal cell carcinoma. Skin parameter maps can be used complementary to regular dermoscopy and could potentially facilitate diagnosing skin lesions.

Hyperspectral imaging enabled by an unmodified smartphone for analyzing skin morphological features and monitoring hemodynamics

We propose a novel method and system that utilizes a popular smartphone to realize hyperspectral imaging for analyzing skin morphological features and monitoring hemodynamics. The imaging system works based on a built-in RGB camera and flashlight on the smartphone. We apply Wiener estimation to transform the acquired RGB-mode images into "pseudo"-hyperspectral images with 16 wavebands, covering a visible range from 470nm to 620nm. The processing method uses weighted subtractions between wavebands to extract absorption information caused by specific chromophores within skin tissue, mainly including hemoglobin and melanin. Based on the extracted absorption information of hemoglobin, we conduct real-time monitoring experiments in the skin to measure heart rate and to observe skin activities during a vascular occlusion event. Compared with expensive hyperspectral imaging systems, the smartphone-based system delivers similar results but with very-high imaging resolution. Besides, it is easy to operate, very cost-effective and has a wider customer base. The use of an unmodified smartphone to realize hyperspectral imaging promises a possibility to bring a hyperspectral analysis of skin out from laboratory and clinical wards to daily life, which may also impact on healthcare in low resource settings and rural areas.

Smartphone based multispectral imager and its potential for point-of-care testing

We report a smartphone based multispectral imager (MSI), a promising tool for point-of-care (POC) testing, which utilizes a bio-inspired MSI chip to capture both the spectral and spatial information of a target simultaneously. As the key component for compact MSI, the proposed MSI chip mimics the structure of an insect compound-eye, wherein each sub-eye responds to a specific spectral band. This could allow a smartphone to be transformed into an MSI device that could acquire a snap-shot spectral image in a single exposure. An orthogonal polarization imaging method is adopted, to boost the capability of the smartphone MSI for chemical analysis. The feasibility and application potential of the proposed device are demonstrated non-invasively for skin lesion and dental plaque analysis. The experimental results are consistent with the physiological expectations, validating the ability of the smartphone MSI for multispectral image acquisition and further analytical determination. The chemical analysis capability, portability and cost-effectiveness of the smartphone MSI make it a promising analytical tool for POC testing, from chemical analysis to in vivo pathological diagnosis.

Fast estimation of optical properties of pear using a single snapshot technique combined with a least-squares support vector regression model based on spatial frequency domain imaging

Spatial frequency domain imaging has great potential in agricultural produce quality control due to its advantage of wide-field mapping of absorption (μ_a) and reduced scattering (μs') parameters. However, it is not widely adopted in real applications due to the large time cost during image acquisition and inversion calculation processes. In this study, a single snapshot technique was used to obtain ac and dc components (R_d_ac, R_d_dc) of diffuse reflectance of turbid media (phantoms and pears). The validation results for the snapshot method indicate that at the spatial frequency of 1000/3  m^-1, it achieved the optimal demodulation, by comparison with the results obtained by the commonly used time-domain amplitude demodulation method. Diffusion approximation, artificial neural network, least-squares support vector machine regression (LSSVR), and LSSVR combined with a genetic algorithm (LSSVR+GA) were then used to predict μ_a and μs' from the obtained R_d_ac, R_d_dc at the f_x of 1000/3  m^-1. Validation results indicated that the LSSVR method took the least time to calculate μ_a and μs' with high performance. The proposed imaging system and algorithm were implemented for the inspection of a pear bruise. Results indicated that the bruise, which is not obviously distinguishable in original gray maps, can show obvious contrast in calculated μ_a and μs' maps, especially in μ_a maps. Further, the contrast becomes more obvious with the passage of time. In summary, this study developed a low-cost spatial frequency imaging system and matching software that could realize fast detection of optical properties for a pear with the proposed snapshot and LSSVR algorithms.

A roadmap for the clinical implementation of optical-imaging biomarkers

Clinical workflows for the non-invasive detection and characterization of disease states could benefit from optical-imaging biomarkers. In this Perspective, we discuss opportunities and challenges towards the clinical implementation of optical-imaging biomarkers for the early detection of cancer by analysing two case studies: the assessment of skin lesions in primary care, and the surveillance of patients with Barrett's oesophagus in specialist care. We stress the importance of technical and biological validations and clinical-utility assessments, and the need to address implementation bottlenecks. In addition, we define a translational roadmap for the widespread clinical implementation of optical-imaging technologies.

In vivo real-time imaging of cutaneous hemoglobin concentration, oxygen saturation, scattering properties, melanin content, and epidermal thickness with visible spatially modulated light

We present the real-time single snapshot multiple frequency demodulation - spatial frequency domain imaging (SSMD-SFDI) platform implemented with a visible digital mirror device that is capable of imaging and monitoring dynamic turbid medium and processes over a large field of view. One challenge in quantitative imaging of biological tissue such as the skin is the complex structure rendering techniques based on homogeneous medium models to fail. To address this difficulty we have also developed a novel method that maps the layered structure to a homogeneous medium for spatial frequency domain imaging. The varying penetration depth of spatially modulated light on its wavelength and modulation frequency is used to resolve the layered structure. The efficacy of the real-time SSMD-SFDI platform and this two-layer model is demonstrated by imaging forearms of 6 healthy subjects under the reactive hyperemia protocol. The results show that our approach not only successfully decouples light absorption by melanin from that by hemoglobin and yields accurate determination of cutaneous hemoglobin concentration and oxygen saturation, but also provides reliable estimation of the scattering properties, the melanin content and the epidermal thickness in real time. Potential applications of our system in imaging skin physiological and functional states, cancer screening, and microcirculation monitoring are discussed at the end.

Smartphone snapshot mapping of skin chromophores under triple-wavelength laser illumination

Chromophore distribution maps are useful tools for skin malformation severity assessment and for monitoring of skin recovery after burns, surgeries, and other interactions. The chromophore maps can be obtained by processing several spectral images of skin, e.g., captured by hyperspectral or multispectral cameras during seconds or even minutes. To avoid motion artifacts and simplify the procedure, a single-snapshot technique for mapping melanin, oxyhemoglobin, and deoxyhemoglobin of in-vivo skin by a smartphone under simultaneous three-wavelength (448–532–659 nm) laser illumination is proposed and examined. Three monochromatic spectral images related to the illumination wavelengths were extracted from the smartphone camera RGB image data set with respect to crosstalk between the RGB detection bands. Spectral images were further processed accordingly to Beer’s law in a three chromophore approximation. Photon absorption path lengths in skin at the exploited wavelengths were estimated by means of Monte Carlo simulations. The technique was validated clinically on three kinds of skin lesions: nevi, hemangiomas, and seborrheic keratosis. Design of the developed add-on laser illumination system, image-processing details, and the results of clinical measurements are presented and discussed.

Portable (handheld) clinical device for quantitative spectroscopy of skin, utilizing spatial frequency domain reflectance techniques

Spatial Frequency Domain Spectroscopy (SFDS) is a technique for quantifying in-vivo tissue optical properties. SFDS employs structured light patterns that are projected onto tissues using a spatial light modulator, such as a digital micromirror device. In combination with appropriate models of light propagation, this technique can be used to quantify tissue optical properties (absorption, μ_a, and scattering, μ_s', coefficients) and chromophore concentrations. Here we present a handheld implementation of an SFDS device that employs line (one dimensional) imaging. This instrument can measure 1088 spatial locations that span a 3 cm line as opposed to our original benchtop SFDS system that only collects a single 1 mm diameter spot. This imager, however, retains the spectral resolution (∼1 nm) and range (450-1000 nm) of our original benchtop SFDS device. In the context of homogeneous turbid media, we demonstrate that this new system matches the spectral response of our original system to within 1% across a typical range of spatial frequencies (0-0.35 mm^-1). With the new form factor, the device has tremendously improved mobility and portability, allowing for greater ease of use in a clinical setting. A smaller size also enables access to different tissue locations, which increases the flexibility of the device. The design of this portable system not only enables SFDS to be used in clinical settings but also enables visualization of properties of layered tissues such as skin.