Screening for urothelial carcinoma cells in urine based on digital holographic flow cytometry through machine learning and deep learning methods

The incidence of urothelial carcinoma continues to rise annually, particularly among the elderly. Prompt diagnosis and treatment can significantly enhance patient survival and quality of life. Urine cytology remains a widely-used early screening method for urothelial carcinoma, but it still has limitations including sensitivity, labor-intensive procedures, and elevated cost. In recent developments, microfluidic chip technology offers an effective and efficient approach for clinical urine specimen analysis. Digital holographic microscopy, a form of quantitative phase imaging technology, captures extensive data on the refractive index and thickness of cells. The combination of microfluidic chips and digital holographic microscopy facilitates high-throughput imaging of live cells without staining. In this study, digital holographic flow cytometry was employed to rapidly capture images of diverse cell types present in urine and to reconstruct high-precision quantitative phase images for each cell type. Then, various machine learning algorithms and deep learning models were applied to categorize these cell images, and remarkable accuracy in cancer cell identification was achieved. This research suggests that the integration of digital holographic flow cytometry with artificial intelligence algorithms offers a promising, precise, and convenient approach for early screening of urothelial carcinoma.

Delivering clinical tutorials to medical students using the Microsoft HoloLens 2: A mixed-methods evaluation

BACKGROUND

Mixed reality offers potential educational advantages in the delivery of clinical teaching. Holographic artefacts can be rendered within a shared learning environment using devices such as the Microsoft HoloLens 2. In addition to facilitating remote access to clinical events, mixed reality may provide a means of sharing mental models, including the vertical and horizontal integration of curricular elements at the bedside. This study aimed to evaluate the feasibility of delivering clinical tutorials using the Microsoft HoloLens 2 and the learning efficacy achieved.

METHODS

Following receipt of institutional ethical approval, tutorials on preoperative anaesthetic history taking and upper airway examination were facilitated by a tutor who wore the HoloLens device. The tutor interacted face to face with a patient and two-way audio-visual interaction was facilitated using the HoloLens 2 and Microsoft Teams with groups of students who were located in a separate tutorial room. Holographic functions were employed by the tutor. The tutor completed the System Usability Scale, the tutor, technical facilitator, patients, and students provided quantitative and qualitative feedback, and three students participated in semi-structured feedback interviews. Students completed pre- and post-tutorial, and end-of-year examinations on the tutorial topics.

RESULTS

Twelve patients and 78 students participated across 12 separate tutorials. Five students did not complete the examinations and were excluded from efficacy calculations. Student feedback contained 90 positive comments, including the technology's ability to broadcast the tutor's point-of-vision, and 62 negative comments, where students noted issues with the audio-visual quality, and concerns that the tutorial was not as beneficial as traditional in-person clinical tutorials. The technology and tutorial structure were viewed favourably by the tutor, facilitator and patients. Significant improvement was observed between students' pre- and post-tutorial MCQ scores (mean 59.2% Vs 84.7%, p < 0.001).

CONCLUSIONS

This study demonstrates the feasibility of using the HoloLens 2 to facilitate remote bedside tutorials which incorporate holographic learning artefacts. Students' examination performance supports substantial learning of the tutorial topics. The tutorial structure was agreeable to students, patients and tutor. Our results support the feasibility of offering effective clinical teaching and learning opportunities using the HoloLens 2. However, the technical limitations and costs of the device are significant, and further research is required to assess the effectiveness of this tutorial format against in-person tutorials before wider roll out of this technology can be recommended as a result of this study.

3D polarization-interference holographic histology for wavelet-based differentiation of the polycrystalline component of biological tissues with different necrotic states. Forensic applications

Significance

The interference-holographic method of phase scanning of fields of scattered laser radiation is proposed. The effectiveness of this method for the selection of variously dispersed components is demonstrated. This method made it possible to obtain polarization maps of biological tissues at a high level of depolarized background. The scale-selective analysis of such maps was used to determine necrotic changes in the optically anisotropic architectonics of biological tissues.

Objective

Development and experimental approbation of layered phase polarimetry of repeatedly scattered fields in diffuse layers of biological tissues. Application of scale-selective processing of the found coordinate distributions of polarization states in various phase sections of object fields. Determination of criteria (markers) for histological differential diagnosis of the causes of necrotic changes in optical anisotropy of biological tissues.

Approach

We used a synthesis of three instrumental and analytical methods. Polarization-interference registration of laser radiation scattered by a sample of biological tissue. Digital holographic reconstruction and layered phase scanning of distributions of complex amplitudes of the object field. Analytical determination of polarization maps of various phase cross-sections of repeatedly scattered radiation. Application of wavelet analysis of the distributions of polarization states in the phase plane of a single scattered component of an object field. Determination of criteria (markers) for differential diagnosis of necrotic changes in biological tissues with different morphological structure. Two cases are considered. The first case is the myocardium of those who died as a result of coronary heart disease and acute coronary insufficiency. The second case is lung tissue samples of deceased with bronchial asthma and fibrosis.

Results

A method of polarization-interference mapping of diffuse object fields of biological tissues has been developed and experimentally implemented. With the help of digital holographic reconstruction of the distributions of complex amplitudes, polarization maps in various phase sections of a diffuse object field are found. The wavelet analysis of azimuth and ellipticity distributions of polarization in the phase plane of a single scattered component of laser radiation is used. Scenarios for changing the amplitude of the wavelet coefficients for different scales of the scanning salt-like MHAT function are determined. Statistical moments of the first to fourth orders are determined for the distributions of the amplitudes of the wavelet coefficients of the azimuth maps and the ellipticity of polarization. As a result, diagnostic markers of necrotic changes in the myocardium and lung tissue were determined. The statistical criteria found are the basis for determining the accuracy of their differential diagnosis of various necrotic states of biological tissues.

Conclusions

Necrotic changes caused by "coronary artery disease-acute coronary insufficiency" and "asthma-pulmonary fibrosis" were demonstrated by the method of wavelet differentiation with polarization interference with excellent accuracy.

Label-Free Single Nanoparticle Identification and Characterization in Demanding Environment, Including Infectious Emergent Virus

Unknown particle screening-including virus and nanoparticles-are keys in medicine, industry, and also in water pollutant determination. Here, RYtov MIcroscopy for Nanoparticles Identification (RYMINI) is introduced, a staining-free, non-invasive, and non-destructive optical approach that is merging holographic label-free 3D tracking with high-sensitivity quantitative phase imaging into a compact optical setup. Dedicated to the identification and then characterization of single nano-object in solution, it is compatible with highly demanding environments, such as level 3 biological laboratories, with high resilience to external source of mechanical and optical noise. Metrological characterization is performed at the level of each single particle on both absorbing and transparent particles as well as on immature and infectious HIV, SARS-CoV-2 and extracellular vesicles in solution. The capability of RYMINI to determine the nature, concentration, size, complex refractive index and mass of each single particle without knowledge or model of the particles' response is demonstrated. The system surpasses 90% accuracy for automatic identification between dielectric/metallic/biological nanoparticles and ≈80% for intraclass chemical determination of metallic and dielectric. It falls down to 50-70% for type determination inside the biological nanoparticle's class.

Holographic Brain Theory: Super-Radiance, Memory Capacity and Control Theory

We investigate Quantum Electrodynamics corresponding to the holographic brain theory introduced by Pribram to describe memory in the human brain. First, we derive a super-radiance solution in Quantum Electrodynamics with non-relativistic charged bosons (a model of molecular conformational states of water) for coherent light sources of holograms. Next, we estimate memory capacity of a brain neocortex, and adopt binary holograms to manipulate optical information. Finally, we introduce a control theory to manipulate holograms involving biological water's molecular conformational states. We show how a desired waveform in holography is achieved in a hierarchical model using numerical simulations.

Hopfion rings in a cubic chiral magnet

Magnetic skyrmions and hopfions are topological solitons1-well-localized field configurations that have gained considerable attention over the past decade owing to their unique particle-like properties, which make them promising objects for spintronic applications. Skyrmions2,3 are two-dimensional solitons resembling vortex-like string structures that can penetrate an entire sample. Hopfions4-9 are three-dimensional solitons confined within a magnetic sample volume and can be considered as closed twisted skyrmion strings that take the shape of a ring in the simplest case. Despite extensive research on magnetic skyrmions, the direct observation of magnetic hopfions is challenging10 and has only been reported in a synthetic material11. Here we present direct observations of hopfions in crystals. In our experiment, we use transmission electron microscopy to observe hopfions forming coupled states with skyrmion strings in B20-type FeGe plates. We provide a protocol for nucleating such hopfion rings, which we verify using Lorentz imaging and electron holography. Our results are highly reproducible and in full agreement with micromagnetic simulations. We provide a unified skyrmion-hopfion homotopy classification and offer insight into the diversity of topological solitons in three-dimensional chiral magnets.

Comprehensive tool for a phase compensation reconstruction method in digital holographic microscopy operating in non-telecentric regime

Quantitative phase imaging (QPI) via Digital Holographic microscopy (DHM) has been widely applied in material and biological applications. The performance of DHM technologies relies heavily on computational reconstruction methods to provide accurate phase measurements. Among the optical configuration of the imaging system in DHM, imaging systems operating in a non-telecentric regime are the most common ones. Nonetheless, the spherical wavefront introduced by the non-telecentric DHM system must be compensated to provide undistorted phase measurements. The proposed reconstruction approach is based on previous work from Kemper's group. Here, we have reformulated the problem, reducing the number of required parameters needed for reconstructing phase images to the sensor pixel size and source wavelength. The developed computational algorithm can be divided into six main steps. In the first step, the selection of the +1-diffraction order in the hologram spectrum. The interference angle is obtained from the selected +1 order. Secondly, the curvature of the spherical wavefront distorting the sample's phase map is estimated by analyzing the size of the selected +1 order in the hologram's spectrum. The third and fourth steps are the spatial filtering of the +1 order and the compensation of the interference angle. The next step involves the estimation of the center of the spherical wavefront. An optional final optimization step has been included to fine-tune the estimated parameters and provide fully compensated phase images. Because the proper implementation of a framework is critical to achieve successful results, we have explicitly described the steps, including functions and toolboxes, required for reconstructing phase images without distortions. As a result, we have provided open-access codes and a user interface tool with minimum user input to reconstruct holograms recorded in a non-telecentric DHM system.

Multispectral in-line hologram reconstruction with aberration compensation applied to Gram-stained bacteria microscopy

In multispectral digital in-line holographic microscopy (DIHM), aberrations of the optical system affect the repeatability of the reconstruction of transmittance, phase and morphology of the objects of interest. Here we address this issue first by model fitting calibration using transparent beads inserted in the sample. This step estimates the aberrations of the optical system as a function of the lateral position in the field of view and at each wavelength. Second, we use a regularized inverse problem approach (IPA) to reconstruct the transmittance and phase of objects of interest. Our method accounts for shift-variant chromatic and geometrical aberrations in the forward model. The multi-wavelength holograms are jointly reconstructed by favouring the colocalization of the object edges. The method is applied to the case of bacteria imaging in Gram-stained blood smears. It shows our methodology evaluates aberrations with good repeatability. This improves the repeatability of the reconstructions and delivers more contrasted spectral signatures in transmittance and phase, which could benefit applications of microscopy, such as the analysis and classification of stained bacteria.

Fluorescence-guided surgical system using holographic display: from phantom studies to canine patients

Significance

Holographic display technology is a promising area of research that can lead to significant advancements in cancer surgery. We present the benefits of combining bioinspired multispectral imaging technology with holographic goggles for fluorescence-guided cancer surgery. Through a series of experiments with 43D-printed phantoms, small animal models of cancer, and surgeries on canine patients with head and neck cancer, we showcase the advantages of this holistic approach.

Aim

The aim of our study is to demonstrate the feasibility and potential benefits of utilizing holographic display for fluorescence-guided surgery through a series of experiments involving 3D-printed phantoms and canine patients with head and neck cancer.

Approach

We explore the integration of a bioinspired camera with a mixed reality headset to project fluorescent images as holograms onto a see-through display, and we demonstrate the potential benefits of this technology through benchtop and in vivo animal studies.

Results

Our complete imaging and holographic display system showcased improved delineation of fluorescent targets in phantoms compared with the 2D monitor display approach and easy integration into the veterinarian surgical workflow.

Conclusions

Based on our findings, it is evident that our comprehensive approach, which combines a bioinspired multispectral imaging sensor with holographic goggles, holds promise in enhancing the presentation of fluorescent information to surgeons during intraoperative scenarios while minimizing disruptions.

Prominent in vivo influence of single interneurons in the developing barrel cortex

Spontaneous synchronous activity is a hallmark of developing brain circuits and promotes their formation. Ex vivo, synchronous activity was shown to be orchestrated by a sparse population of highly connected GABAergic 'hub' neurons. The recent development of all-optical methods to record and manipulate neuronal activity in vivo now offers the unprecedented opportunity to probe the existence and function of hub cells in vivo. Using calcium imaging, connectivity analysis and holographic optical stimulation, we show that single GABAergic, but not glutamatergic, neurons influence population dynamics in the barrel cortex of non-anaesthetized mouse pups. Single GABAergic cells mainly exert an inhibitory influence on both spontaneous and sensory-evoked population bursts. Their network influence scales with their functional connectivity, with highly connected hub neurons displaying the strongest impact. We propose that hub neurons function in tailoring intrinsic cortical dynamics to external sensory inputs.

Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning

A plaque assay-the gold-standard method for measuring the concentration of replication-competent lytic virions-requires staining and usually more than 48 h of runtime. Here we show that lens-free holographic imaging and deep learning can be combined to expedite and automate the assay. The compact imaging device captures phase information label-free at a rate of approximately 0.32 gigapixels per hour per well, covers an area of about 30 × 30 mm2 and a 10-fold larger dynamic range of virus concentration than standard assays, and quantifies the infected area and the number of plaque-forming units. For the vesicular stomatitis virus, the automated plaque assay detected the first cell-lysing events caused by viral replication as early as 5 h after incubation, and in less than 20 h it detected plaque-forming units at rates higher than 90% at 100% specificity. Furthermore, it reduced the incubation time of the herpes simplex virus type 1 by about 48 h and that of the encephalomyocarditis virus by about 20 h. The stain-free assay should be amenable for use in virology research, vaccine development and clinical diagnosis.

Empty space and the (positive) cosmological constant

I discuss empty space, as it appears in the physical foundations of relativistic field theories and in the semiclassical study of isolated systems. Of particular interest is the relationship between empirical measurements of the cosmological constant and the question of appropriate representation of empty space by spacetimes, or models of general relativity. Also considered is a speculative move that shows up in one corner of quantum gravity research. In pursuit of holographic quantum cosmology given a positive cosmological constant, there is evidently some freedom available for theoretical physicists to pick between two physically inequivalent spacetime representations of empty space, moving forward: de Sitter spacetime or its 'elliptic' cousin.

Integrated lithium niobate optical phased array for two-dimensional beam steering

Optical phased arrays (OPAs) with high speed, low power consumption, and low insertion loss are appealing for various applications, including light detection and ranging, free-space communication, image projection, and imaging. These OPAs can be achieved by fully harnessing the advantages of integrated lithium niobate (LN) photonics, which include high electro-optical modulation speed, low driving voltage, and low optical loss. Here we present an integrated LN OPA that operates in the near-infrared regime. Our experimental results demonstrate 24 × 8° two-dimensional beam steering, a far-field beam spot with a full width at half maximum of 2 × 0.6°, and a sidelobe suppression level of 10 dB. Furthermore, the phase modulator of our OPA exhibits a half-wave voltage of 6 V. The low power consumption exhibited by our OPA makes it highly attractive for a wide range of applications. Beyond conventional applications, our OPA's high speed opens up the possibility of novel applications such as high-density point cloud generation and tomographic holography.

Modal phase-locking in multimode nonlinear optical fibers

Spatial beam self-cleaning, a manifestation of the Kerr effect in graded-index multimode fibers, involves a nonlinear transfer of power among modes, which leads to robust bell-shaped output beams. The resulting mode power distribution can be described by statistical mechanics arguments. Although the spatial coherence of the output beam was experimentally demonstrated, there is no direct study of modal phase evolutions. Based on a holographic mode decomposition method, we reveal that nonlinear spatial phase-locking occurs between the fundamental and its neighboring low-order modes, in agreement with theoretical predictions. As such, our results dispel the current belief that the spatial beam self-cleaning effect is the mere result of a wave thermalization process.

Augmented Reality Holographic Visualization System for Surgery Auxiliary Visualization: Proof of Concept for Surgical Training

An Augmented Reality (AR) system based on the holographic projection of the relevant anatomic structures is proposed for auxiliary visualization during surgeries. The current two-dimensional visualization systems require the surgeons to mentally extract the associated three-dimensional information during the interventions, which entails risks and complications. This work shows an AR holographic projection system for real-time three-dimensional representation of the relevant surgical information, thus overcoming this problem. As an initial proof of concept, the system is experimentally assessed as potential surgery training tool.Clinical Relevance- This work explores the potential of AR holographic projection systems for intraoperative assistance to the surgical team, starting from its possible use as surgery training and planning tool.

Imaging conformations of holo- and apo-transferrin on the single-molecule level by low-energy electron holography

Conformational changes play a key role in the biological function of many proteins, thereby sustaining a multitude of processes essential to life. Thus, the imaging of the conformational space of proteins exhibiting such conformational changes is of great interest. Low-energy electron holography (LEEH) in combination with native electrospray ion beam deposition (ES-IBD) has recently been demonstrated to be capable of exploring the conformational space of conformationally highly variable proteins on the single-molecule level. While the previously studied conformations were induced by changes in environment, it is of relevance to assess the performance of this imaging method when applied to protein conformations inherently tied to a function-related conformational change. We show that LEEH imaging can distinguish different conformations of transferrin, the major iron transport protein in many organisms, by resolving a nanometer-scale cleft in the structure of the iron-free molecule (apo-transferrin) resulting from the conformational change associated with the iron binding/release process. This, along with a statistical analysis of the data, which evidences a degree of flexibility of the molecules, indicates that LEEH is a viable technique for imaging function-related conformational changes in individual proteins.

Structured illumination phase and fluorescence microscopy for bioimaging

This study presents a dual-modality microscopic imaging approach that combines quantitative phase microscopy and fluorescence microscopy based on structured illumination (SI) to provide structural and functional information for the same sample. As the first imaging modality, structured illumination digital holographic microscopy (SI-DHM) is implemented along the transmission beam path. SI-DHM acts as a label-free, noninvasive approach and provides high-contrast and quantitative phase images utilizing the refractive index contrast of the inner structures of samples against the background. As the second imaging modality, structured illumination (fluorescence) microscopy (SIM) is constructed along the reflection beam path. SIM utilizes fluorescent labeling and provides super-resolution images for specific functional structures of samples. We first experimentally demonstrated phase imaging of SI-DHM on rice leaves and fluorescence (SIM) imaging on mouse kidney sections. Then, we demonstrated dual-modality imaging of biological samples, using DHM to acquire the overall cell morphology and SIM to obtain specific functional structures. These results prove that the proposed technique is of great importance in biomedical studies, such as providing insight into cell physiology by visualizing and quantifying subcellular structures.

Single-shot multispectral quantitative phase imaging of biological samples using deep learning

Multispectral quantitative phase imaging (MS-QPI) is a high-contrast label-free technique for morphological imaging of the specimens. The aim of the present study is to extract spectral dependent quantitative information in single-shot using a highly spatially sensitive digital holographic microscope assisted by a deep neural network. There are three different wavelengths used in our method: λ=532, 633, and 808 nm. The first step is to get the interferometric data for each wavelength. The acquired datasets are used to train a generative adversarial network to generate multispectral (MS) quantitative phase maps from a single input interferogram. The network was trained and validated on two different samples: the optical waveguide and MG63 osteosarcoma cells. Validation of the present approach is performed by comparing the predicted MS phase maps with numerically reconstructed (F T+T I E) phase maps and quantifying with different image quality assessment metrices.

Lens Free Holographic Imaging for Urinary Tract Infection Screening

OBJECTIVE

The diagnosis of urinary tract infection (UTI) currently requires precise specimen collection, handling infectious human waste, controlled urine storage, and timely transportation to modern laboratory equipment for analysis. Here we investigate holographic lens free imaging (LFI) to show its promise for enabling automatic urine analysis at the patient bedside.

METHODS

We introduce an LFI system capable of resolving important urine clinical biomarkers such as red blood cells, white blood cells, crystals, and casts in 2 mm thick urine phantoms.

RESULTS

This approach is sensitive to the particulate concentrations relevant for detecting several clinical urine abnormalities such as hematuria and pyuria, linearly correlating to ground truth hemacytometer measurements with R 2 = 0.9941 and R 2 = 0.9973, respectively. We show that LFI can estimate E. coli concentrations of 10 3 to 10 5 cells/mL by counting individual cells, and is sensitive to concentrations of 10 5 cells/mL to 10 8 cells/mL by analyzing hologram texture. Further, LFI measurements of blood cell concentrations are relatively insensitive to changes in bacteria concentrations of over seven orders of magnitude. Lastly, LFI reveals clear differences between UTI-positive and UTI-negative urine from human patients.

CONCLUSION

LFI is sensitive to clinically-relevant concentrations of bacteria, blood cells, and other sediment in large urine volumes.

SIGNIFICANCE

Together, these results show promise for LFI as a tool for urine screening, potentially offering early, point-of-care detection of UTI and other pathological processes.

Compact holographic sound fields enable rapid one-step assembly of matter in 3D

Acoustic waves exert forces when they interact with matter. Shaping ultrasound fields precisely in 3D thus allows control over the force landscape and should permit particulates to fall into place to potentially form whole 3D objects in "one shot." This is promising for rapid prototyping, most notably biofabrication, since conventional methods are typically slow and apply mechanical or chemical stress on biological cells. Here, we realize the generation of compact holographic ultrasound fields and demonstrate the one-step assembly of matter using acoustic forces. We combine multiple holographic fields that drive the contactless assembly of solid microparticles, hydrogel beads, and biological cells inside standard labware. The structures can be fixed via gelation of the surrounding medium. In contrast to previous work, this approach handles matter with positive acoustic contrast and does not require opposing waves, supporting surfaces or scaffolds. We envision promising applications of 3D holographic ultrasound fields in tissue engineering and additive manufacturing.

State-of-the-Art Electron Microscopy For Physical Sciences Research

ARTICLES DISCUSSED

Moon, T., Colletta, M., Kourkoutis, L. F. Nanoscale characterization of liquid-solid interfaces by couple cryo-focused ion beam milling with scanning electron microscopy and spectroscopy. Journal of Visualized Experiments. (185), e61955 (2022). Ohtsuka, M., Muto, S. Quantitative atomic-site analysis of functional dopants/point defects in crystalline materials by electron-channeling-enhanced microanalysis. Journal of Visualized Experiments. (171), e62015 (2021). Miao, L., Chmielewski, A., Mukherjee, D., Alem, N. Picometer-precision atomic position tracking through electron microscopy. Journal of Visualized Experiments. (173), e62164 (2021). Unocic, K. A. et al. Performing in situ closed-cell gas reactions in the transmission electron microscope. Journal of Visualized Experiments. (173), e62174 (2021). Zheng, F. et al. Magnetic field mapping using off-axis electron holography in the transmission electron microscope. Journal of Visualized Experiments. (166), e61907 (2020).

Scalable Hydrogel-Based Nanocavities for Switchable Meta-Holography with Dynamic Color Printing

Devices used for meta-optics display are currently undergoing a revolutionary transition from static to dynamic. Despite various tuning strategy demonstrations such as mechanical, electrical, optical, and thermal tunings, a longstanding challenge for their practical application has been the achievement of a conveniently accessible real-life tuning scheme for realizing versatile functionality dynamics outside the laboratory. In this study, we demonstrate a practical tuning strategy to realize a dynamic color printing with a switchable meta-holography exhibition based on hydrogel-based nanocavities. On the basis of the inflation sensitivity of a hydrogel to humidity alteration, its transmissive color was notably tuned from 450 to 750 nm. More intriguingly, by controlling the sample dry/immersed states in real time, we successfully enabled dual-channel switchable meta-holography. With the advantages of facile architecture, daily stimulus with large-area modulation, and high chromaticity, our proposed hydrogel-based nanocavities provide a promising path toward tunable display/encryption, optical sensors, and next-generation display technology.

Lensless phase-only holographic retinal projection display based on the error diffusion algorithm

Holographic retinal projection display (RPD) can project images directly onto the retina without any lens by encoding a convergent spherical wave phase with the target images. Conventional amplitude-type holographic RPD suffers from strong zero-order light and conjugate. In this paper, a lensless phase-only holographic RPD based on error diffusion algorithm is demonstrated. It is found that direct error diffusion of the complex Fresnel hologram leads to low image quality. Thus, a post-addition phase method is proposed based on angular spectrum diffraction. The spherical wave phase is multiplied after error diffusion process, and acts as an imaging lens. In this way, the error diffusion functions better due to reduced phase difference between adjacent pixels, and a virtual image with improved quality is produced. The viewpoint is easily deflected just by changing the post-added spherical phase. A full-color holographic RPD with adjustable eyebox is demonstrated experimentally with time-multiplexing technique.

Challenges in Implementing Low-Latency Holographic-Type Communication Systems

Holographic-type communication (HTC) permits new levels of engagement between remote users. It is anticipated that it will give a very immersive experience while enhancing the sense of spatial co-presence. In addition to the newly revealed advantages, however, stringent system requirements are imposed, such as multi-sensory and multi-dimensional data capture and reproduction, ultra-lightweight processing, ultra-low-latency transmission, realistic avatar embodiment conveying gestures and facial expressions, support for an arbitrary number of participants, etc. In this paper, we review the current limitations to the HTC system implementation and systemize the main challenges into a few major groups. Furthermore, we propose a conceptual framework for the realization of an HTC system that will guarantee the desired low-latency transmission, lightweight processing, and ease of scalability, all accompanied with a higher level of realism in human body appearance and dynamics.