Frameworks of wavelength selection in diffuse reflectance spectroscopy for tissue differentiation in orthopedic surgery

Significance

Wavelength selection from a large diffuse reflectance spectroscopy (DRS) dataset enables removal of spectral multicollinearity and thus leads to improved understanding of the feature domain. Feature selection (FS) frameworks are essential to discover the optimal wavelengths for tissue differentiation in DRS-based measurements, which can facilitate the development of compact multispectral optical systems with suitable illumination wavelengths for clinical translation.

Aim

The aim was to develop an FS methodology to determine wavelengths with optimal discriminative power for orthopedic applications, while providing the frameworks for adaptation to other clinical scenarios.

Approach

An ensemble framework for FS was developed, validated, and compared with frameworks incorporating conventional algorithms, including principal component analysis (PCA), linear discriminant analysis (LDA), and backward interval partial least squares (biPLS).

Results

Via the one-versus-rest binary classification approach, a feature subset of 10 wavelengths was selected from each framework yielding comparable balanced accuracy scores (PCA: 94.8 ± 3.47 % , LDA: 98.2 ± 2.02 % , biPLS: 95.8 ± 3.04 % , and ensemble: 95.8 ± 3.16 % ) to those of using all features (100%) for cortical bone versus the rest class labels. One hundred percent balanced accuracy scores were generated for bone cement versus the rest. Different feature subsets achieving similar outcomes could be identified due to spectral multicollinearity.

Conclusions

Wavelength selection frameworks provide a means to explore domain knowledge and discover important contributors to classification in spectroscopy. The ensemble framework generated a model with improved interpretability and preserved physical interpretation, which serves as the basis to determine illumination wavelengths in optical instrumentation design.

Ultra high-speed single-molecule fluorescence imaging

In two articles in this issue, Fujiwara et al. developed an ultrasensitive high-speed camera capable of single-molecule fluorescence imaging at a microsecond timescale (2023. J. Cell Biol.https://doi.org/10.1083/jcb.202110160). This major leap in detection speed enables the organization of plasma membrane and integrin-based adhesions to be probed in unprecedented detail (2023. J. Cell Biol.https://doi.org/10.1083/jcb.202110162).

Quantitative Indocyanine Green Fluorescence Imaging Assessment for Nonmucinous Peritoneal Metastases: Preliminary Results of the ICCP Study

BACKGROUND

In selected patients with peritoneal metastases of colorectal origin, complete cytoreduction has been the main single prognostic factor influencing long-term outcomes. In these patients, indocyanine green fluorescence imaging seems to be useful in detecting small subclinical peritoneal implants. However, quantitative fluorescence analysis has not yet been established as standard.

OBJECTIVE

This study aimed to evaluate the sensitivity and specificity of quantitative indocyanine green fluorescence assessment in the detection of peritoneal metastases of nonmucinous colorectal origin.

DESIGN

This is a single-center, single-arm, low-intervention prospective trial.

SETTINGS

A fluorescence assessment device was used for intraoperative fluorescence quantitative assessment.

PATIENTS

Consecutive patients diagnosed with peritoneal metastases of colorectal origin who met the inclusion criteria were selected for curative surgery.

INTERVENTIONS

Intravenous indocyanine green was administered 12 hours before surgery. Cytoreduction was performed through nodule identification under white light and then under indocyanine green. Finally, ex vivo fluorescence was assessed.

MAIN OUTCOME MEASURES

The primary outcomes measured were the sensitivity and specificity of quantitative fluorescence.

RESULTS

The first 11 enrolled patients were included in this preliminary analysis. In total, 52 nodules were resected, with 37 (71.1%) being diagnosed as malignant in the histopathological analysis. Of those, 5 (13.5%) were undetectable under white light and were identified only with fluorescence. A total of 15 nonmalignant nodules were detected under white light, 8 (53.3%) of which were fluorescence negative. Fluorescence greater than 181 units might be the threshold of malignancy, with a sensitivity and specificity of 89.0% and 85.0%, whereas uptake less than 100 units appears to correlate with a benign pathology.

LIMITATIONS

The limited sample size, the physiological uptake, and excretion of indocyanine green might interfere with the assessment of unnoticed implants in the bowel serosa and liver.

CONCLUSIONS

Quantitative indocyanine green seems to be useful for the assessment of nonmucinous colorectal peritoneal metastases. Fluorescence uptake greater than 181 units appears to correlate with malignancy, whereas uptake less than 100 units appears to correlate with a benign pathology. See Video Abstract at http://links.lww.com/DCR/B743.

EVALUACIN CUANTITATIVA DE IMGENES DE FLUORESCENCIA CON VERDE DE INDOCIANINA PARA METSTASIS PERITONEALES NO MUCINOSAS RESULTADOS PRELIMINARES DEL ESTUDIO ICCP

ANTECEDENTES:En pacientes seleccionados con metástasis peritoneales de origen colorrectal, la citorreducción com-pleta ha sido el único factor pronóstico principal que influye en el resultado a largo plazo. En estos pacientes, las imágenes de fluorescencia con verde de indocianina parecen ser útiles para detectar pequeños implantes peritoneales subclínicos. Sin embargo, el análisis cuantitativo de fluorescencia aún no se ha establecido como estándar.OBJETIVO:Evaluar la sensibilidad y especificidad de la evaluación cuantitativa de fluorescencia verde de indo-cianina, en la detección de metástasis peritoneales de origen colorrectal no mucinoso.DISEÑO:Ensayo prospectivo de intervención baja de un solo brazo y un solo centro.ENTORNO CLINICO:El dispositivo se utilizó para la evaluación cuantitativa de fluorescencia intraoperatoria.PACIENTES:Pacientes consecutivos diagnosticados con metástasis peritoneales de origen colorrectal, selecciona-dos para cirugía curativa y que cumplieron con los criterios de inclusión.INTERVENCIONES:Se administró verde de indocianina por vía intravenosa 12 h antes de la cirugía. La citorreducción se realizó mediante identificación de nódulos con luz blanca y luego con verde de indocianina. Final-mente, se evaluó la fluorescencia ex vivo.PRINCIPALES MEDIDAS DE VALORACION:Sensibilidad y especificidad cuantitativa de la fluorescencia.RESULTADOS:Los primeros 11 pacientes fueron incluidos en este análisis preliminar. En total se resecaron 52 nódu-los, siendo 37 (71,1%) diagnosticados como malignos en el análisis histopatológico. De ellos, 5 (13,5%) eran indetectables bajo luz blanca y solamente se identificaron con fluorescencia. Se detec-taron un total de 15 nódulos no malignos bajo luz blanca, de los cuales 8 (53,3%) fueron fluorescen-tes negativos. La fluorescencia superior a 181 unidades podría ser el umbral de malignidad, con una sensibilidad y especificidad del 89,0% y el 85,0% respectivamente; mientras que la captación por debajo de 100 unidades parece correlacionarse con una patología benigna.LIMITACIONES:El tamaño limitado de la muestra; la captación fisiológica y la excreción de verde de indocianina pueden interferir con la evaluación de implantes inadvertidos en la serosa intestinal y el hígado.CONCLUSIONES:La cuantificación del verde de indocianina, parece ser útil en la evaluación de metástasis peritonea-les colorrectales no mucinosas. La captación de fluorescencia por encima de 181 unidades parece correlacionarse con la malignidad, mientras que la captación por debajo de 100 unidades parece co-rrelacionarse con una patología benigna. Consulte Video Resumen en http://links.lww.com/DCR/B743. (Traducción - Dr. Fidel Ruiz Healy).

Achromatic doublet electrowetting prism array for beam steering device in foveated display

A foveated display is a technology that can solve the problem of insufficient angular resolution (relative to the human eye) for near-eye display. In a high-resolution foveated display, a beam steering element is required to track the human gaze. An electrowetting prism array is a transmissive non-mechanical beam steering device, that allows a light and compact optical system to be configured and a large aperture possible. However, the view is obstructed by the sidewall of the prism array. When the size of the cell prism is 7mm, the prism array has an 87% fill-factor. To push the fill-factor to 100%, the cell prisms were magnified using a lens array. Image processing was performed such that the image produced by the lens array was identical to the original. Beam steering by refraction is accompanied by chromatic dispersion, which causes chromatic aberration, making colors appear blurry. The refractive index condition to reduce chromatic dispersion was obtained using the doublet structure of the electrowetting prism. The chromatic dispersion was reduced by 70% on average.

The challenge of determining lysyl oxidase activity: Old methods and novel approaches

The lysyl oxidase (LOX) family of enzymes catalyze the oxidative deamination of lysine and hydroxylysine residues in collagen and elastin in the initiation step of the formation of covalent cross-linkages, an essential process for extracellular matrix (ECM) maturation. Elevated LOX expression levels leading to increased LOX activity is associated with diverse pathologies including fibrosis, cancer, and cardiovascular diseases. Different protocols have been so far established to detect and quantify LOX activity from tissue samples and cultured cells, all of them showing advantages and drawbacks. This review article presents a critical overview of the main features of currently available methods as well as introduces some recent technologies called to revolutionize our approach to LOX catalysis.

Waveguide-type see-through dual focus near-eye display with a polarization grating

Waveguide-type near-eye displays have useful properties such as compact form factor, lightweight and see-through capability. Conventional systems, however, support only a single image plane fixed at a certain distance, which may induce eye fatigue due to the vergence-accommodation conflict. In this paper, we propose a waveguide-type near-eye display with two image planes using a polarization grating. Two images with orthogonal polarizations propagate within the waveguide with different total internal reflection angles and form virtual images at different distances. The use of the polarization grating and two pairs of holographic optical elements enables dual image plane formation by a single waveguide with high transparency for the real scene. Optical experiments confirm the principle of the proposed optical system.

Flexible foveated imaging using a single Risley-prism imaging system

Foveated imaging, which has the ability to provide overall situational awareness over a large field of view and high-resolution perception of local details, has significant advantages in many specific applications. However, existing artificially foveated imaging systems are complex, bulky, and expensive, and the flexibility of the fovea specifically has many limitations. To overcome these deficiencies, this paper proposes a method for foveated imaging by collecting multiple partially overlapping sub-fields of view. To capture the above special sub-fields of view, we propose a high-efficiency algorithm based on the characteristics of the field of view deflected by the Risley-prism and aimed at solving the prism rotation angles. In addition, we prove the reliability of the proposed algorithm by cross-validation with the particle swarm optimization algorithm. The experimental results show that the proposed method can achieve flexible foveated imaging using a single Risley-prism imaging system.

Diesel2p mesoscope with dual independent scan engines for flexible capture of dynamics in distributed neural circuitry

Imaging the activity of neurons that are widely distributed across brain regions deep in scattering tissue at high speed remains challenging. Here, we introduce an open-source system with Dual Independent Enhanced Scan Engines for Large field-of-view Two-Photon imaging (Diesel2p). Combining optical design, adaptive optics, and temporal multiplexing, the system offers subcellular resolution over a large field-of-view of ~25 mm2, encompassing distances up to 7 mm, with independent scan engines. We demonstrate the flexibility and various use cases of this system for calcium imaging of neurons in the living brain.

Flexible simultaneous mesoscale two-photon imaging of neural activity at high speeds

Understanding brain function requires monitoring local and global brain dynamics. Two-photon imaging of the brain across mesoscopic scales has presented trade-offs between imaging area and acquisition speed. We describe a flexible cellular resolution two-photon microscope capable of simultaneous video rate acquisition of four independently targetable brain regions spanning an approximate five-millimeter field of view. With this system, we demonstrate the ability to measure calcium activity across mouse sensorimotor cortex at behaviorally relevant timescales.

A Two-Photon Microimaging-Microdevice System for Four-Dimensional Imaging of Local Drug Delivery in Tissues

Advances in the intratumor measurement of drug responses have included a pioneering biomedical microdevice for high throughput drug screening in vivo, which was further advanced by integrating a graded-index lens based two-dimensional fluorescence micro-endoscope to monitor tissue responses in situ across time. While the previous system provided a bulk measurement of both drug delivery and tissue response from a given region of the tumor, it was incapable of visualizing drug distribution and tissue responses in a three-dimensional (3D) way, thus missing the critical relationship between drug concentration and effect. Here we demonstrate a next-generation system that couples multiplexed intratumor drug release with continuous 3D spatial imaging of the tumor microenvironment via the integration of a miniaturized two-photon micro-endoscope. This enables optical sectioning within the live tissue microenvironment to effectively profile the entire tumor region adjacent to the microdevice across time. Using this novel microimaging-microdevice (MI-MD) system, we successfully demonstrated the four-dimensional imaging (3 spatial dimensions plus time) of local drug delivery in tissue phantom and tumors. Future studies include the use of the MI-MD system for monitoring of localized intra-tissue drug release and concurrent measurement of tissue responses in live organisms, with applications to study drug resistance due to nonuniform drug distribution in tumors, or immune cell responses to anti-cancer agents.

Subdiffraction-resolution fluorescence imaging of immunological synapse formation between NK cells and A. fumigatus by expansion microscopy

Expansion microscopy (ExM) enables super-resolution fluorescence imaging on standard microscopes by physical expansion of the sample. However, the investigation of interactions between different organisms such as mammalian and fungal cells by ExM remains challenging because different cell types require different expansion protocols to ensure identical, ideally isotropic expansion of both partners. Here, we introduce an ExM method that enables super-resolved visualization of the interaction between NK cells and Aspergillus fumigatus hyphae. 4-fold expansion in combination with confocal fluorescence imaging allows us to resolve details of cytoskeleton rearrangement as well as NK cells' lytic granules triggered by contact with an RFP-expressing A. fumigatus strain. In particular, subdiffraction-resolution images show polarized degranulation upon contact formation and the presence of LAMP1 surrounding perforin at the NK cell-surface post degranulation. Our data demonstrate that optimized ExM protocols enable the investigation of immunological synapse formation between two different species with so far unmatched spatial resolution.

Efficient Organic Upconversion Devices for Low Energy Consumption and High-Quality Noninvasive Imaging

Infrared upconversion devices (UCDs) enable low-cost visualization of infrared optical signals without utilizing a readout circuit, which is of great significance for biological recognition and noninvasive dynamic monitoring. However, UCDs suffer from inferior photon to photon (p-p) efficiency and high turn-on voltage (V_on ) for upconversion operation, hindering a further expansion in highly resolved infrared imaging. Herein, an efficient organic UCD integrating an interfacial exciplex emitter and a well-designed near-infrared (NIR) detector reveals a high efficiency up to 12.92% and a low V_on down to 1.56 V. The low V_on gives the capacity for detecting weak NIR light down to 3.2 µW cm^-2 , significantly expanding the detection power scale of UCDs. Thus, the imaging linear dynamic range (I-LDR) is highly bias-tunable, ranging from 13.23 to 84.4 dB. The high I-LDR enables highly resolved and strong-penetration bioimaging especially for thick biological sections, indicating great potential in noninvasive defect and pathological detection.

Visualizing bleb mass dynamics in single cells using quantitative phase microscopy

Understanding biological responses to directed energy (DE) is critical to ensure the safety of personnel within the Department of Defense. At the Air Force Research Laboratory, we have developed or adapted advanced optical imaging systems that quantify biophysical responses to DE. One notable cellular response to DE exposure is the formation of blebs, or semi-spherical protrusions of the plasma membrane in living cells. In this work, we demonstrate the capacity of quantitative phase imaging (QPI) to both visualize and quantify the formation of membrane blebs following DE exposure. QPI is an interferometric imaging tool that uses optical path length as a label-free contrast mechanism and is sensitive to the non-aqueous mass density, or dry mass, of living cells. Blebs from both CHO-K1 and U937 cells were generated after exposure to a series of 600 ns, 21.2 kV/cm electric pulses. These blebs were visualized in real time, and their dry mass relative to the rest of the cell body was quantified as a function of time. It is our hope that this system will lead to an improved understanding of both DE-induced and apoptotic blebbing.

Fourier transform acousto-optic imaging with off-axis holographic detection

Acousto-optic (AO) imaging is an in-depth optical imaging technique of highly scattering media. One challenging end-application for this technique is to perform imaging of living biological tissues. Indeed, because it relies on coherent illumination, AO imaging is sensitive to speckle decorrelation occurring on the millisecond time scale. Camera-based detections are well suited for in vivo imaging provided their integration time is lower than those decorrelation time scales. We present Fourier transform acousto-optic imaging combined with off-axis holography, which relies on plane waves and long-duration pulses. We demonstrate, for the first time to the best of our knowledge, a two-dimensional imaging system fully compatible with in vivo imaging prerequisites. The method is validated experimentally by performing in-depth imaging inside a multiple scattering sample.

High-dynamic-range blood flow rate measurement in a large-diameter vessel

We propose a new, to the best of our knowledge, compound technique to measure high-dynamic-range blood flow rate in a large-diameter vessel, which combines the dynamic scattering light (DLS) and the laser speckle contrast imaging (LSCI) methods, possessing the advantages of the high temporal resolution of DLS and the robust property of LSCI. By controlling the second-order spatial correlations of the laser speckle through two imaging systems, the speckle temporal intensity autocorrelation function g²(t) and the decorrelation time τ_c are directly measured using a high-speed camera. It turns out the enhanced spatial second-order correlation helps to measure the blood flow with higher dynamic range and that the measured parameter β and the blood flow dynamics n were accurately determined. For further improvement the dynamic range, the modified LSCI method was adopted, and the decorrelation time as a function of blood flow rate was constructed. It reveals the feasibility of measuring the high flow rate in large-diameter vessels and provides significant guidance for the future biomedical study of the myocardial perfusion in coronary artery bypass grafting, ghost imaging, and ghost cytometry.

Imaging biological tissue with high-throughput single-pixel compressive holography

Single-pixel holography (SPH) is capable of generating holographic images with rich spatial information by employing only a single-pixel detector. Thanks to the relatively low dark-noise production, high sensitivity, large bandwidth, and cheap price of single-pixel detectors in comparison to pixel-array detectors, SPH is becoming an attractive imaging modality at wavelengths where pixel-array detectors are not available or prohibitively expensive. In this work, we develop a high-throughput single-pixel compressive holography with a space-bandwidth-time product (SBP-T) of 41,667 pixels/s, realized by enabling phase stepping naturally in time and abandoning the need for phase-encoded illumination. This holographic system is scalable to provide either a large field of view (~83 mm2) or a high resolution (5.80 μm × 4.31 μm). In particular, high-resolution holographic images of biological tissues are presented, exhibiting rich contrast in both amplitude and phase. This work is an important step towards multi-spectrum imaging using a single-pixel detector in biophotonics.

TREND database: Retinal images of healthy young subjects visualized by a portable digital non-mydriatic fundus camera

Topological characterization of the Retinal microvascular nEtwork visualized by portable fuNDus camera (TREND) is a database comprising of 72 color digital retinal images collected from the students of the Faculty of Medicine at the University of Montenegro, in the period from February 18th to March 11th 2020. The database also includes binarized images of manually segmented microvascular networks associated with each raw image. The participant demographic characteristics, health status, and social habits information such as age, sex, body mass index, smoking history, alcohol use, as well as previous medical history was collected. As proof of the concept, a smaller set of 10 color digital fundus images from healthy older participants is also included. Comparison of the microvascular parameters of these two sets of images demonstrate that digital fundus images recorded with a hand-held portable camera are able to capture the changes in patterns of microvascular network associated with aging. The raw images from the TREND database provide a standard that defines normal retinal anatomy and microvascular network geometry in young healthy people in Montenegro as it is seen with the digital hand-held portable non-mydriatic MiiS HORUS Scope DEC 200.This knowledge could facilitate the application of this technology at the primary level of health care for large scale telematic screening for complications of chronic diseases, such as hypertensive and diabetic retinopathy. In addition, it could aid in the development of new methods for early detection of age-related changes in the retina, systemic chronic diseases, as well as eye-specific diseases. The associated manually segmented images of the microvascular networks provide the standard that can be used for development of automatic software for image quality assessment, segmentation of microvascular network, and for computer-aided detection of pathological changes in retina. The TREND database is freely available at https://doi.org/10.5281/zenodo.4521043.

A Fluorescent Real-Time Plaque Assay Enables Single-Cell Analysis of Virus-Induced Cytopathic Effect by Live-Cell Imaging

Conventional plaque assays rely on the use of overlays to restrict viral infection allowing the formation of distinct foci that grow in time as the replication cycle continues leading to countable plaques that are visualized with standard techniques such as crystal violet, neutral red, or immunolabeling. This classical approach takes several days until large enough plaques can be visualized and counted with some variation due to subjectivity in plaque recognition. Since plaques are clonal lesions produced by virus-induced cytopathic effect, we applied DNA fluorescent dyes with differential cell permeability to visualize them by live-cell imaging. We could observe different stages of that cytopathic effect corresponding to an early wave of cells with chromatin-condensation followed by a wave of dead cells with membrane permeabilization within plaques generated by different animal viruses. This approach enables an automated plaque identification using image analysis to increase single plaque resolution compared to crystal violet counterstaining and allows its application to plaque tracking and plaque reduction assays to test compounds for both antiviral and cytotoxic activities. This fluorescent real-time plaque assay sums to those next-generation technologies by combining this robust classical method with modern fluorescence microscopy and image analysis approaches for future applications in virology.

Comparison of Optical Low-Coherence Reflectometry and Swept-Source OCT-Based Biometry Devices in Dense Cataracts

PURPOSE

To investigate agreement between biometric measurements obtained from the Lenstar LS 900 (Haag-Streit AG) based on optical low-coherence reflectometry (OLCR) and the Tomey OA-2000 (Tomey Corporation) based on swept-source optical coherence tomography (SS-OCT) in dense cataracts.

METHODS

In this prospective observational study, axial length, keratometry, anterior chamber depth (ACD), lens thickness, and central corneal thickness (CCT) were measured in 124 eyes of 76 patients. Intraocular lens prediction errors and absolute prediction errors were assessed based on postoperative manifest refraction. Analyses used were paired t test, Pearson correlation coefficient (r), and Bland-Altman plots.

RESULTS

Failure in axial length measurements was noted in 28 eyes (22.58%) with OCLR compared to 2 eyes (1.6%) with SS-OCT. Although not statistically significant, axial length measurements were clinically higher with SS-OCT (23.78 ± 1.76 mm) compared to OCLR (23.72 ± 1.58 mm) (P = .81) (r = 0.23; P = .01). There was a significant trend toward myopic intraocular lens prediction with SS-OCT (-0.09 ± 0.48) compared to OLCR (0.09 ± 0.41, P < .01) (r = 0.25, P = .01). There was good agreement for keratometric and ACD values between the two devices. SS-OCT gave significantly higher values of lens thickness compared to OCLR (4.44 ± 0.44 vs 4.18 ± 0.48 mm, P < .01) (r = 0.39, P < .01). CCT measured with OCLR was significantly higher than SS-OCT (525.64 ± 27.0 vs 513.21 ± 29.24 µm; P < .01) (r = 0.98, P < .01).

CONCLUSIONS

One-fifth of the patients with dense cataracts failed axial length measurement on OCLR. SS-OCT gives clinically higher axial length measurements leading to more myopic intraocular lens prediction errors postoperatively. OCLR provides higher pachymetry and lower lens thickness values compared to the SS-OCT device. [J Refract Surg. 2020;36(8):557-564.].

Image formation by a biological curved mirror array of the fisheye in the deep-sea environment

In this paper, we present the imaging formation process of the piecewise mirror eyes of the deep-sea spookfish, which has a strange combination of refractive and reflective eyes. The biological reflective eye structure is formulated to the curved surface's flat mirror array. Zemax is utilized to evaluate optical features such as the modulation transfer function, distortion, and imaging performances. However, the natural images are highly distorted, and the resolution is lower than expected. Therefore, we increase the number of piecewise mirrors of the fisheye to see higher quality images, which can be improved entirely by the mirror shapes. Finally, the fisheye's imaging analysis reveals the deep-sea creature's resolution limit and also shows the possibility of artificial and biomimetic camera applications.

Background-free dual-mode optical and 13C magnetic resonance imaging in diamond particles

Multimodal imaging-the ability to acquire images of an object through more than one imaging mode simultaneously-has opened additional perspectives in areas ranging from astronomy to medicine. In this paper, we report progress toward combining optical and magnetic resonance (MR) imaging in such a "dual" imaging mode. They are attractive in combination because they offer complementary advantages of resolution and speed, especially in the context of imaging in scattering environments. Our approach relies on a specific material platform, microdiamond particles hosting nitrogen vacancy (NV) defect centers that fluoresce brightly under optical excitation and simultaneously "hyperpolarize" lattice [Formula: see text] nuclei, making them bright under MR imaging. We highlight advantages of dual-mode optical and MR imaging in allowing background-free particle imaging and describe regimes in which either mode can enhance the other. Leveraging the fact that the two imaging modes proceed in Fourier-reciprocal domains (real and k-space), we propose a sampling protocol that accelerates image reconstruction in sparse-imaging scenarios. Our work suggests interesting possibilities for the simultaneous optical and low-field MR imaging of targeted diamond nanoparticles.

Fast widefield scan provides tunable and uniform illumination optimizing super-resolution microscopy on large fields

Non-uniform illumination limits quantitative analyses of fluorescence imaging techniques. In particular, single molecule localization microscopy (SMLM) relies on high irradiances, but conventional Gaussian-shaped laser illumination restricts the usable field of view to around 40 µm × 40 µm. We present Adaptable Scanning for Tunable Excitation Regions (ASTER), a versatile illumination technique that generates uniform and adaptable illumination. ASTER is also highly compatible with optical sectioning techniques such as total internal reflection fluorescence (TIRF). For SMLM, ASTER delivers homogeneous blinking kinetics at reasonable laser power over fields-of-view up to 200 µm × 200 µm. We demonstrate that ASTER improves clustering analysis and nanoscopic size measurements by imaging nanorulers, microtubules and clathrin-coated pits in COS-7 cells, and β2-spectrin in neurons. ASTER's sharp and quantitative illumination paves the way for high-throughput quantification of biological structures and processes in classical and super-resolution fluorescence microscopies.

Distinct place cell dynamics in CA1 and CA3 encode experience in new environments

When exploring new environments animals form spatial memories that are updated with experience and retrieved upon re-exposure to the same environment. The hippocampus is thought to support these memory processes, but how this is achieved by different subnetworks such as CA1 and CA3 remains unclear. To understand how hippocampal spatial representations emerge and evolve during familiarization, we performed 2-photon calcium imaging in mice running in new virtual environments and compared the trial-to-trial dynamics of place cells in CA1 and CA3 over days. We find that place fields in CA1 emerge rapidly but tend to shift backwards from trial-to-trial and remap upon re-exposure to the environment a day later. In contrast, place fields in CA3 emerge gradually but show more stable trial-to-trial and day-to-day dynamics. These results reflect different roles in CA1 and CA3 in spatial memory processing during familiarization to new environments and constrain the potential mechanisms that support them.

Helium-4 magnetometers for room-temperature biomedical imaging: toward collective operation and photon-noise limited sensitivity

Optically-pumped magnetometers constitute a valuable tool for imaging biological magnetic signals without cryogenic cooling. Nowadays, numerous developments are being pursued using alkali-based magnetometers, which have demonstrated excellent sensitivities in the spin-exchange relaxation free (SERF) regime that requires heating to >100 °C. In contrast, metastable helium-4 based magnetometers work at any temperature, which allows a direct contact with the scalp, yielding larger signals and a better patient comfort. However former ⁴He magnetometers displayed large noises of >200 fT/Hz^1/2 with 300-Hz bandwidth. We describe here an improved magnetometer reaching a sensitivity better than 50 fT/Hz^1/2, nearly the photon shot noise limit, with a bandwidth of 2 kHz. Like other zero-field atomic magnetometers, these magnetometers can be operated in closed-loop architecture reaching several hundredths nT of dynamic range. A small array of 4 magnetometers operating in a closed loop has been tested with a successful correction of the cross-talks.

MR-compatible optical microscope for in-situ dual-mode MR-optical microscopy

We present the development of a dual-mode imaging platform that combines optical microscopy with magnetic resonance microscopy. Our microscope is designed to operate inside a 9.4T small animal scanner with the option to use a 72mm bore animal RF coil or different integrated linear micro coils. With a design that minimizes the magnetic distortions near the sample, we achieved a field inhomogeneity of 19 ppb RMS. We further integrated a waveguide in the optical layout for the electromagnetic shielding of the camera, which minimizes the noise increase in the MR and optical images below practical relevance. The optical layout uses an adaptive lens for focusing, 2 × 2 modular combinations of objectives with 0.6mm to 2.3mm field of view and 4 configurable RGBW illumination channels and achieves a plano-apochromatic optical aberration correction with 0.6μm to 2.3μm resolution. We present the design, implementation and characterization of the prototype including the general optical and MR-compatible design strategies, a knife-edge optical characterization and different concurrent imaging demonstrations.

Design of a near-eye display measurement system using an anthropomorphic vision imaging method

We developed a new near-eye display measurement system using anthropomorphic vision imaging to measure the key parameters of near-eye displays, including field-of-view (FOV), angular resolution, eye box, and virtual image depth. The characteristics of the human eye, such as pupil position, pupil size variation, accommodation function, and the high resolution of the fovea, are imitated by the proposed measurement system. A FOV scanning structure, together with a non-vignetting image-telecentric lens system, captures the virtual image from the near-eye display by imitating human eye function. As a proof-of-concept, a prototype device was used to obtain large-range, high-resolution measurements for key parameters of near-eye displays.

Hyperspectral interference tomography of nacre

Structural characterization of biologically formed materials is essential for understanding biological phenomena and their enviro-nment, and for generating new bio-inspired engineering concepts. For example, nacre-the inner lining of some mollusk shells-encodes local environmental conditions throughout its formation and has exceptional strength due to its nanoscale brick-and-mortar structure. This layered structure, comprising alternating transparent aragonite (CaCO3) tablets and thinner organic polymer layers, also results in stunning interference colors. Existing methods of structural characterization of nacre rely on some form of cross-sectional analysis, such as scanning or transmission electron microscopy or polarization-dependent imaging contrast (PIC) mapping. However, these techniques are destructive and too time- and resource-intensive to analyze large sample areas. Here, we present an all-optical, rapid, and nondestructive imaging technique-hyperspectral interference tomography (HIT)-to spatially map the structural parameters of nacre and other disordered layered materials. We combined hyperspectral imaging with optical-interference modeling to infer the mean tablet thickness and its disorder in nacre across entire mollusk shells from red and rainbow abalone (Haliotis rufescens and Haliotis iris) at various stages of development. We observed that in red abalone, unexpectedly, nacre tablet thickness decreases with age of the mollusk, despite roughly similar appearance of nacre at all ages and positions in the shell. Our rapid, inexpensive, and nondestructive method can be readily applied to in-field studies.

Transparent capacitive micromachined ultrasound transducer linear arrays for combined realtime optical and ultrasonic imaging

Transparent ultrasound transducers could enable many novel applications involving both ultrasonics and optics. Recently, we reported transparent capacitive micromachined ultrasound transducers (CMUTs) and demonstrated through-illumination photoacoustic imaging. This work presents the feasibility of transparent CMUTs for combined ultrasound imaging and through-array white-light imaging with a miniature camera placed behind the array. Transparent CMUT devices are fabricated with an adhesive wafer bonding technique and provide high transparency up to 90% in visible wavelengths. Fabricated linear arrays have a central operating frequency of 9 MHz with 128 active elements. Realtime plane-wave imaging is performed for ultrasound imaging, and lateral and axial resolutions of, respectively, 234 and 338 µm are achieved. Transparent CMUT has demonstrated a high transmit sensitivity of 1.4 kPa/V per channel with a 100 VDC bias voltage. The signal-to-noise ratio for a beamformed image of wire targets is determined to be 28.4 dB. To the best of our knowledge, this is the first report of combined realtime optical and ultrasonic imaging with transparent arrays. This technology may enable one to visually see what is being scanned and scan what one sees without co-registration errors. Future applications could include multi-modality probes for interventional and surgical procedures.

Recent trends in smartphone-based detection for biomedical applications: a review

Smartphone-based imaging devices (SIDs) have shown to be versatile and have a wide range of biomedical applications. With the increasing demand for high-quality medical services, technological interventions such as portable devices that can be used in remote and resource-less conditions and have an impact on quantity and quality of care. Additionally, smartphone-based devices have shown their application in the field of teleimaging, food technology, education, etc. Depending on the application and imaging capability required, the optical arrangement of the SID varies which enables them to be used in multiple setups like bright-field, fluorescence, dark-field, and multiple arrays with certain changes in their optics and illumination. This comprehensive review discusses the numerous applications and development of SIDs towards histopathological examination, detection of bacteria and viruses, food technology, and routine diagnosis. Smartphone-based devices are complemented with deep learning methods to further increase the efficiency of the devices. Graphical Abstract.

Initial Clinical Experience of Cherenkov Imaging in External Beam Radiation Therapy Identifies Opportunities to Improve Treatment Delivery

PURPOSE

The value of Cherenkov imaging as an on-patient, real-time, treatment delivery verification system was examined in a 64-patient cohort during routine radiation treatments in a single-center study.

METHODS AND MATERIALS

Cherenkov cameras were mounted in treatment rooms and used to image patients during their standard radiation therapy regimen for various sites, predominantly for whole breast and total skin electron therapy. For most patients, multiple fractions were imaged, with some involving bolus or scintillators on the skin. Measures of repeatability were calculated with a mean distance to conformity (MDC) for breast irradiation images.

RESULTS

In breast treatments, Cherenkov images identified fractions when treatment delivery resulted in dose on the contralateral breast, the arm, or the chin and found nonideal bolus positioning. In sarcoma treatments, safe positioning of the contralateral leg was monitored. For all 199 imaged breast treatment fields, the interfraction MDC was within 7 mm compared with the first day of treatment (with only 7.5% of treatments exceeding 3 mm), and all but 1 fell within 7 mm relative to the treatment plan. The value of imaging dose through clear bolus or quantifying surface dose with scintillator dots was examined. Cherenkov imaging also was able to assess field match lines in cerebral-spinal and breast irradiation with nodes. Treatment imaging of other anatomic sites confirmed the value of surface dose imaging more broadly.

CONCLUSIONS

Daily radiation therapy can be imaged routinely via Cherenkov emissions. Both the real-time images and the posttreatment, cumulative images provide surrogate maps of surface dose delivery that can be used for incident discovery and/or continuous improvement in many delivery techniques. In this initial 64-patient cohort, we discovered 6 minor incidents using Cherenkov imaging; these otherwise would have gone undetected. In addition, imaging provides automated, quantitative metrics useful for determining the quality of radiation therapy delivery.

Rapid isolation method of Saccharomyces cerevisiae based on optically induced dielectrophoresis technique for fungal infection diagnosis

Saccharomyces cerevisiae(S. cerevisiae) has been classically used as a treatment for diarrhea and diarrhea-related diseases. However, cases of the fungal infections caused by S. cerevisiae have been increasing in the last two decades among immunocompromised patients, while a long time was spent on S. cerevisiae isolation clinically so it was difficult to achieve timely diagnosis the diseases. Here, a novel approach for isolation and selection of S. cerevisiae is proposed by designing a microfluidic chip with an optically induced dielectrophoresis (ODEP) system. S. cerevisiae was isolated from the surroundings by ODEP due to different dielectrophoretic forces. Two special light images were designed and used to block and separate S. cerevisiae, respectively, and several manipulation parameters of ODEP were experimentally optimized to acquire the maximum isolation efficiency of S. cerevisiae. The results on the S. cerevisiae isolation declared that the purity of the S. cerevisiae selected by the method was up to 99.5%±0.05, and the capture efficiency was up to 65.0%±2.5 within 10 min. This work provides a general method to isolate S. cerevisiae as well as other microbial cells with high accuracy and efficiency and paves a road for biological research in which the isolation of high-purity cells is required.

Incoherent color digital holography with computational coherent superposition for fluorescence imaging [Invited]

We present color fluorescence imaging using an incoherent digital holographic technique in which holographic multiplexing of multiple wavelengths is exploited. Self-interference incoherent digital holography with a single-path in-line configuration and the computational coherent superposition scheme are adopted to obtain color holographic three-dimensional information of self-luminous objects with a monochrome image sensor and no mechanical scanning. We perform not only simultaneous color three-dimensional sensing of multiple self-luminous objects but also color fluorescence imaging of stained biological samples. Color fluorescence imaging with an improved point spread function is also demonstrated experimentally by adopting a Fresnel incoherent correlation holography system.

Multimodal in vivo recording using transparent graphene microelectrodes illuminates spatiotemporal seizure dynamics at the microscale

Neurological disorders such as epilepsy arise from disrupted brain networks. Our capacity to treat these disorders is limited by our inability to map these networks at sufficient temporal and spatial scales to target interventions. Current best techniques either sample broad areas at low temporal resolution (e.g. calcium imaging) or record from discrete regions at high temporal resolution (e.g. electrophysiology). This limitation hampers our ability to understand and intervene in aberrations of network dynamics. Here we present a technique to map the onset and spatiotemporal spread of acute epileptic seizures in vivo by simultaneously recording high bandwidth microelectrocorticography and calcium fluorescence using transparent graphene microelectrode arrays. We integrate dynamic data features from both modalities using non-negative matrix factorization to identify sequential spatiotemporal patterns of seizure onset and evolution, revealing how the temporal progression of ictal electrophysiology is linked to the spatial evolution of the recruited seizure core. This integrated analysis of multimodal data reveals otherwise hidden state transitions in the spatial and temporal progression of acute seizures. The techniques demonstrated here may enable future targeted therapeutic interventions and novel spatially embedded models of local circuit dynamics during seizure onset and evolution.

Challenges of conducting quantitative ultrasound with a multimodal optical imaging system

High-frequency quantitative ultrasound is a potential non-invasive source of imaging cell-tissue scale biomarkers for major diseases such as heart disease, cancer, and preterm birth. However, one of the barriers to developing such biomarkers is that it is labor-intensive to compare quantitative ultrasound images to optical images of the tissue structure. We have previously developed a multiscale imaging system that can obtain registered qualitative ultrasound and optical images, but there are further technical challenges to obtaining quantitative data: System-specific details of obtaining and processing data with Verasonics high-frequency transducers; the need for high-frequency reference phantoms; and off-axis clutter from imaging above a glass coverslip. This paper provides a characterization of the Verasonics ultrasound system with the 18.5 MHz L22-14v and 28.5 MHz L38-22v transducers, describes the construction of high-frequency reference phantoms, and details methods for reducing off-axis clutter. The paper features a demonstration multiscale image of a wild type mouse mammary gland that incorporates quantitative ultrasound with both transducers and second harmonic generation microscopy. These advances demonstrate a way to obtain, on a single system with a cohesive and integrated pipeline, quantitative ultrasound data that is correlated with optical imaging without the need for extensive sample preparation.

Amplification-free detection of SARS-CoV-2 with CRISPR-Cas13a and mobile phone microscopy

The December 2019 outbreak of a novel respiratory virus, SARS-CoV-2, has become an ongoing global pandemic due in part to the challenge of identifying symptomatic, asymptomatic, and pre-symptomatic carriers of the virus. CRISPR diagnostics can augment gold-standard PCR-based testing if they can be made rapid, portable, and accurate. Here, we report the development of an amplification-free CRISPR-Cas13a assay for direct detection of SARS-CoV-2 from nasal swab RNA that can be read with a mobile phone microscope. The assay achieved ∼100 copies/μL sensitivity in under 30 min of measurement time and accurately detected pre-extracted RNA from a set of positive clinical samples in under 5 min. We combined crRNAs targeting SARS-CoV-2 RNA to improve sensitivity and specificity and directly quantified viral load using enzyme kinetics. Integrated with a reader device based on a mobile phone, this assay has the potential to enable rapid, low-cost, point-of-care screening for SARS-CoV-2.

Real-Time Monitoring of APC /C-Mediated Substrate Degradation Using Xenopus laevis Egg Extracts

The anaphase promoting complex/cyclosome (APC/C), a large E3 ubiquitin ligase, is a key regulator of mitotic progression. Upon activation in mitosis, the APC/C targets its two essential substrates, securin and cyclin B, for proteasomal destruction. Cyclin B is the activator of cyclin-dependent kinase 1 (Cdk1), the major mitotic kinase, and both cyclin B and securin are safeguards of sister chromatid cohesion. Conversely, the degradation of securin and cyclin B promotes sister chromatid separation and mitotic exit. The negative feedback loop between Cdk1 and APC/C-Cdk1 activating the APC/C and the APC/C inactivating Cdk1-constitutes the core of the biochemical cell cycle oscillator.Since its discovery three decades ago, the mechanisms of APC /C regulation have been intensively studied, and several in vitro assays exist to measure the activity of the APC /C in different activation states. However, most of these assays require the purification of numerous recombinant enzymes involved in the ubiquitylation process (e.g., ubiquitin, the E1 and E2 ubiquitin ligases, and the APC /C) and/or the use of radioactive isotopes. In this chapter, we describe an easy-to-implement method to continuously measure APC /C activity in Xenopus laevis egg extracts using APC /C substrates fused to fluorescent proteins and a fluorescence plate reader. Because the egg extract provides all important enzymes and proteins for the reaction, this method can be used largely without the need for recombinant protein purification. It can also easily be adapted to test the activity of APC /C mutants or investigate other mechanisms of APC /C regulation.

Nanoparticles for In Vivo Lifetime Multiplexed Imaging

Lifetime multiplexed imaging refers to the simultaneous labeling of different structures with fluorescent probes that present identical photoluminescence spectra and distinct fluorescence lifetimes. This technique allows extracting quantitative information from multichannel in vivo fluorescence imaging. In vivo lifetime multiplexed imaging requires fluorophores with excitation and emission bands in the near-infrared (NIR) and tunable fluorescence lifetimes, plus an imaging system capable of time-resolved image acquisition and analysis.

Visualizing Mouse Embryo Gastrulation Epithelial-Mesenchymal Transition Through Single Cell Labeling Followed by Ex Vivo Whole Embryo Live Imaging

Epithelial-mesenchymal transition (EMT) is often studied in pathological contexts, such as cancer or fibrosis. This chapter focuses on physiological EMT that allows the separation of germ layers during mouse embryo gastrulation. In order to record individual cells behavior with high spatial and temporal resolution live imaging as they undergo EMT, it is very helpful to label the cells of interest in a mosaic fashion so as to facilitate cell segmentation and quantitative image analysis. This protocol describes the isolation, culture, and live imaging of E6.5-E7.5 mouse embryos mosaically labeled in the epiblast, the epithelium from which mesoderm and endoderm layers arise through EMT at gastrulation.

Robust scan synchronized force-fluorescence imaging

Simultaneous atomic force microscope (AFM) and sample scanning confocal fluorescence microscope measurements are widely used to obtain mechanistic and structural insights into protein dynamics in live cells. However, the absence of a robust technique to synchronously scan both AFM and confocal microscope piezo stages makes it difficult to visualize force-induced changes in fluorescent protein distribution in cells.  To address this challenge, we have built an integrated AFM-confocal fluorescence microscope platform that implements a synchronous scanning method which eliminates image artifacts from piezo motion ramping, produces accurate pixel binning and enables the collection of a scanned image of a sample while applying force to a single point on the sample. As proof of principle, we use this instrument to monitor the redistribution of fluorescent E-cadherin, an essential transmembrane protein, in live cells, upon application of mechanical force.

Volumetric two-photon fluorescence imaging of live neurons using a multimode optical fiber

Multimode optical fibers (MMFs), combined with wavefront control methods, have achieved minimally invasive in vivo imaging of neurons in deep-brain regions with diffraction-limited spatial resolution. Here, we report a method for volumetric two-photon fluorescence imaging with a MMF-based system requiring a single transmission matrix measurement. Central to this method is the use of a laser source able to generate both continuous wave light and femtosecond pulses. The chromatic dispersion of pulses generated an axially elongated excitation focus, which we used to demonstrate volumetric imaging of neurons and their dendrites in live rat brain slices through a 60 µm core MMF.

Shortwave infrared polymethine fluorophores matched to excitation lasers enable non-invasive, multicolour in vivo imaging in real time

High-resolution, multiplexed experiments are a staple in cellular imaging. Analogous experiments in animals are challenging, however, due to substantial scattering and autofluorescence in tissue at visible (350-700 nm) and near-infrared (700-1,000 nm) wavelengths. Here, we enable real-time, non-invasive multicolour imaging experiments in animals through the design of optical contrast agents for the shortwave infrared (SWIR, 1,000-2,000 nm) region and complementary advances in imaging technologies. We developed tunable, SWIR-emissive flavylium polymethine dyes and established relationships between structure and photophysical properties for this class of bright SWIR contrast agents. In parallel, we designed an imaging system with variable near-infrared/SWIR excitation and single-channel detection, facilitating video-rate multicolour SWIR imaging for optically guided surgery and imaging of awake and moving mice with multiplexed detection. Optimized dyes matched to 980 nm and 1,064 nm lasers, combined with the clinically approved indocyanine green, enabled real-time, three-colour imaging with high temporal and spatial resolutions.

Single pixel hyperspectral Cherenkov-excited fluorescence imaging with LINAC X-ray sheet scanning and spectral unmixing

Cherenkov light induced from megavolt (MV) X-rays during external beam radiotherapy serves as an internal light source to excite phosphors or fluorophores within biological tissues for molecular imaging. The broad spectrum of Cherenkov light leads to significant spectral overlap with any luminescence emission and, to overcome this problem, a single pixel hyperspectral imaging methodology was demonstrated here by coupling the detection with light sheet scanning and filtered back projection reconstruction of hyperspectral images. Thin scanned sheets of MV X-rays produce Cherenkov light to illuminate the planes deep within the tissue-simulating media. A fluorescence probe was excited by Cherenkov light, and a complete hyperspectral sinogram of the data was obtained through translation and rotation of the beam. Hyperspectral 2D images finally were reconstructed. Through this approach of spectral unmixing, it was possible to resolve hyperspectral images of both the Cherenkov and resulting fluorescence intensity from molecular sensors.

Super-resolution imaging with an achromatic multi-level diffractive microlens array

Compound eyes found in insects provide intriguing sources of biological inspiration for miniaturized imaging systems. Inspired by such insect eye structures, we demonstrate an ultrathin arrayed camera enabled by a flat multi-level diffractive microlens array for super-resolution visible imaging. We experimentally demonstrate that the microlens array can achieve a large fill factor (hexagonal close packing with pitch=120µm), thickness of 2.6 µm, and diffraction-limited (Strehlratio=0.88) achromatic performance in the visible band (450 to 650 nm). We also demonstrate super-resolution imaging with resolution improvement of ∼1.4 times by computationally merging 1600 images in the array.

Red blood cell classification in lensless single random phase encoding using convolutional neural networks

Rapid cell identification is achieved in a compact and field-portable system employing single random phase encoding to record opto-biological signatures of living biological cells of interest. The lensless, 3D-printed system uses a diffuser to encode the complex amplitude of the sample, then the encoded signal is recorded by a CMOS image sensor for classification. Removal of lenses in this 3D sensing system removes restrictions on the field of view, numerical aperture, and depth of field normally imposed by objective lenses in comparable microscopy systems to enable robust 3D capture of biological volumes. Opto-biological signatures for two classes of animal red blood cells, situated in a microfluidic device, are captured then input into a convolutional neural network for classification, wherein the AlexNet architecture, pretrained on the ImageNet database is used as the deep learning model. Video data was recorded of the opto-biological signatures for multiple samples, then each frame was treated as an input image to the network. The pre-trained network was fine-tuned and evaluated using a dataset of over 36,000 images. The results show improved performance in comparison to a previously studied Random Forest classification model using extracted statistical features from the opto-biological signatures. The system is further compared to and outperforms a similar shearing-based 3D digital holographic microscopy system for cell classification. In addition to improvements in classification performance, the use of convolutional neural networks in this work is further demonstrated to provide improved performance in the presence of noise. Red blood cell identification as presented here, may serve as a key step toward lensless pseudorandom phase encoding applications in rapid disease screening. To the best of our knowledge this is the first report of lensless cell identification in single random phase encoding using convolutional neural networks.

Implementing selective edge enhancement in nonlinear optics

Recently, it has been demonstrated that a nonlinear spatial filter using second harmonic generation can implement a visible edge enhancement under invisible illumination, and it provides a promising application in biological imaging with light-sensitive specimens. But with this nonlinear spatial filter, all phase or intensity edges of a sample are highlighted isotropically, independent of their local directions. Here we propose a vectorial one to cover this shortage. Our vectorial nonlinear spatial filter uses two cascaded nonlinear crystals with orthogonal optical axes to produce superposed nonlinear vortex filtering. We show that with the control of the polarization of the invisible illumination, one can highlight the features of the samples in special directions visually. Moreover, we find the intensity of the sample arm can be weaker by two orders of magnitude than the filter arm. This striking feature may offer a practical application in biological imaging or microscopy, since the light field reflected from the sample is always weak. Our work offers an interesting way to see and emphasize the different directions of edges or contours of phase and intensity objects with the polarization control of the invisible illumination.

Single-shot stereo-polarimetric compressed ultrafast photography for light-speed observation of high-dimensional optical transients with picosecond resolution

Simultaneous and efficient ultrafast recording of multiple photon tags contributes to high-dimensional optical imaging and characterization in numerous fields. Existing high-dimensional optical imaging techniques that record space and polarization cannot detect the photon's time of arrival owing to the limited speeds of the state-of-the-art electronic sensors. Here, we overcome this long-standing limitation by implementing stereo-polarimetric compressed ultrafast photography (SP-CUP) to record light-speed high-dimensional events in a single exposure. Synergizing compressed sensing and streak imaging with stereoscopy and polarimetry, SP-CUP enables video-recording of five photon tags (x, y, z: space; t: time of arrival; and ψ: angle of linear polarization) at 100 billion frames per second with a picosecond temporal resolution. We applied SP-CUP to the spatiotemporal characterization of linear polarization dynamics in early-stage plasma emission from laser-induced breakdown. This system also allowed three-dimensional ultrafast imaging of the linear polarization properties of a single ultrashort laser pulse propagating in a scattering medium.

Integrated Neurophotonics: Toward Dense Volumetric Interrogation of Brain Circuit Activity-at Depth and in Real Time

We propose a new paradigm for dense functional imaging of brain activity to surmount the limitations of present methodologies. We term this approach "integrated neurophotonics"; it combines recent advances in microchip-based integrated photonic and electronic circuitry with those from optogenetics. This approach has the potential to enable lens-less functional imaging from within the brain itself to achieve dense, large-scale stimulation and recording of brain activity with cellular resolution at arbitrary depths. We perform a computational study of several prototype 3D architectures for implantable probe-array modules that are designed to provide fast and dense single-cell resolution (e.g., within a 1-mm3 volume of mouse cortex comprising ∼100,000 neurons). We describe progress toward realizing integrated neurophotonic imaging modules, which can be produced en masse with current semiconductor foundry protocols for chip manufacturing. Implantation of multiple modules can cover extended brain regions.

A Percutaneous Catheter for In Vivo Hyperspectral Imaging of Cardiac Tissue: Challenges, Solutions and Future Directions

PURPOSE

Multiple studies have shown that spectral analysis of tissue autofluorescence can be used as a live indicator for various pathophysiological states of cardiac tissue, including ischemia, ablation-induced damage, or scar formation. Yet today there are no percutaneous devices that can detect autofluorescence signals from inside a beating heart. Our aim was to develop a prototype catheter to demonstrate the feasibility of doing so.

METHODS AND RESULTS

Here we summarize technical solutions leading to the development of a percutaneous catheter capable of multispectral imaging of intracardiac surfaces. The process included several iterations of light sources, optical filtering, and image acquisition techniques. The developed system included a compliant balloon, 355 nm laser irradiance, a high-sensitivity CCD, bandpass filtering, and image acquisition synchronized with the cardiac cycle. It enabled us to capture autofluorescence images from multiple spectral bands within the visible range while illuminating the endocardial surface with ultraviolet light. Principal component analysis and other spectral unmixing post-processing algorithms were then used to reveal target tissue.

CONCLUSION

Based on the success of our prototype system, we are confident that the development of ever more sensitive cameras, recent advances in tunable filters, fiber bundles, and other optical and computational components makes it possible to create percutaneous catheters capable of acquiring hyper or multispectral hypercubes, including those based on autofluorescence, in real-time. This opens the door for widespread use of this methodology for high-resolution intraoperative imaging of internal tissues and organs-including cardiovascular applications.

Microscopy approaches to study extracellular vesicles

BACKGROUND

Extracellular vesicles (EVs) have drawn the attention of both biological researchers and clinical physicians due to their function in mediating cell-to-cell communication and relevance as potential diagnostic markers. Since their discovery, the small size and heterogeneity of EVs has posed a hindrance to their characterization as well as to the definition of their biological significance.

SCOPE OF THE REVIEW

Recent technological advances have considerably expanded the tools available for EV studies. In particular, the combination of novel microscope setups with high resolution imaging and the flexibility in EV labelling allows for the precise detection and characterization of the molecular composition of single EVs. Here we will review the microscopy techniques that have been applied to unravel the mechanism of EV-mediated intercellular communication and to study their molecular composition.

MAJOR CONCLUSIONS

Microscopy technologies have largely contributed to our understanding of molecular processes, including EV biology. As we discuss in this review, careful experimental planning is necessary to identify the most appropriate technique to use to answer a specific question.

GENERAL SIGNIFICANCE

The considerations regarding microscopy and experimental planning that are discussed here are applicable to the characterization of other small structures, including synthetic nanovectors and viruses.

A method to identify pulmonary intersegmental planes with intravenous vitamin B2 injection

PURPOSE

The present study investigated whether the pulmonary intersegmental planes could be identified with the intravenous injection of vitamin B₂ using a fluorescent camera and whether this method can be used instead of the inflation-deflation technique or the intravenous indocyanine green (ICG) method.

METHODS

In experiment 1, the vitamin B₂ was intravenously injected to visualize the pulmonary intersegmental plane and perform segmentectomy, and the visualized pulmonary intersegmental line was then compared to the inflation-deflation line in six pigs. In experiment 2, using six pigs, the fluorescent area and duration of fluorescence were compared after the intravenous injection of vitamin B₂ and ICG in the same animals.

RESULTS

In all animals in experiment 1, it was possible to clearly detect yellow-green fluorescence in the lung, in segments other than the one intended for resection, for at least 60 min. Moreover, the line visualized with vitamin B₂ fluorescence matched the inflation-deflation line in all animals. In experiment 2, the area of vitamin B₂ fluorescence corresponded to the area of ICG fluorescence in each animal.

CONCLUSIONS

The visualization of fluorescence after the intravenous injection of vitamin B₂ using a fluorescent camera was a simple, safe, and accurate method for detecting intersegmental planes in a pig model. This method can be an alternative to the inflation-deflation technique and the intravenous ICG method.