Holographic three-dimensional printer: new method

HEVC extension for phase hologram compression

Compressing digital holograms have growing attention nowadays due to their huge amount of original data sizes. Although many progresses have been reported for full-complex holograms, the coding performance for phase-only holograms (POHs) has been quite limited so far. In this paper, we present a very efficient compression method for POHs. It extends the conventional video coding standard HEVC (High Efficiency Video Coding) in such a way that the standard can be able to compress not only the natural images but also the phase images effectively. First, we suggest a proper way to calculate differences, distances and clipped values for phase signals by considering the inherent periodicity of phases. Then, some of the HEVC encoding and decoding processes are modified accordingly. The experimental results show that the proposed extension significantly outperforms the original HEVC for POH video sequences; specifically, average BD-rate reductions of 63.3% and 65.5% are achieved in phase domain and numerical reconstruction domain, respectively. It is worth mentioning that the modified encoding & decoding processes are very minimal and also applicable to the VVC (Versatile Video Coding), which is a successor of the HEVC.

Multiplane holographic augmented reality head-up display with a real-virtual dual mode and large eyebox

We propose a multiplane augmented reality (AR) head-up display (HUD) with a real-virtual dual mode based on holographic optical elements (HOEs). The picture generation unit (PGU) is only a single free-focus projector, and the optical combiner includes a HOE lens (HOEL) for long-distance virtual image display and a HOE diffuser (HOED) for in-plane real image display. A HOED with directional scattering characteristics in the real image mode can significantly increase the size of the eyebox (EB) without increasing the size of the HOE, and a HOEL with a flexible design for the optical focal length in the virtual image mode can be used to achieve a different depth of the AR display. The proposed AR HUD system, which has a compact structure and offers high light transmittance, high energy usage, a multiplane display, and a large EB, is expected to be widely used in the future.

Analysis of potential distortions corresponding to the hologram printed by a holographic wave-front printer

In this paper, potential distortions corresponding to the hologram printed by a holographic wave-front printer are analyzed. Potential distortions are classified as the magnification(demagnification) distortion, barrel distortion, pincushion distortion, SLM mounting distortion, and translation distortion, respectively. These distortions are grouped as the optics distortion, SLM mounting distortion and the translation distortion depending on the process of recording the hologram in the holographic wave-front printer. In order to evaluate each distortion, a distortion analysis method based on a local spatial frequency is proposed. Through the proposed method, a diffracted wavefield reconstructed from a quantitatively distorted hologram is theoretically analyzed, and the validity of this analysis is verified by applying the numerical reconstruction method. In the numerical reconstruction, a propagation of a distorted wavefield reconstructed from the quantitatively distorted hologram is confirmed and contributed to generate the distorted reconstruction plane, such as a focal cloud plane and a convergence plane, depending on the types of distortion.

JPEG Pleno holography: scope and technology validation procedures

JPEG Pleno is a standardization framework addressing the compression and signaling of plenoptic modalities. While the standardization of solutions to handle light field content is currently reaching its final stage, the Joint Photographic Experts Group (JPEG) committee is now preparing for the standardization of solutions targeting point cloud and holographic modalities. This paper addresses the challenges related to the standardization of compression technologies for holographic content and associated test methodologies.

View-flipping effect reduction and reconstruction visualization enhancement for EPISM based holographic stereogram with optimized hogel size

To reduce the view-flipping effect and enhance the viewing resolution, the modulation characteristics of the hogel based holographic stereogram is constructed and validated. The performance of the view-flipping effect is analyzed, and the results indicate that decreasing the size of hogel is beneficial to the reduction of the view flipping, however, which will result in significant diffraction effect which can degrade the reconstruction quality. Furthermore, a diffraction-limited imaging model of the hogel based holographic stereogram is established, where both the limited aperture of the hogel and the defocused aberration of the object point are introduced, and the effective resolvable size of the reconstructed image point is simulated. The theory shows that there is an optimal hogel size existed for the certain depth of scene. Both the numerical and optical experiments are implemented, and the results are well agreed with the theoretical prediction, which demonstrates that the view-flipping reduction and reconstruction visualization enhancement for EPISM based holographic stereogram can be achieved when the proper size of hogel is utilized.

Holographically customized optical combiner for eye-box extended near-eye display

We propose a customizing method of a holographic optical element (HOE) by using a holographic printer, which extends the eye-box with high field of view (FOV) for a holographic augmented reality near-eye display (AR NED). The holographic printer setup to manufacture HOE is presented and a prototype of the AR NED is implemented. To make a simple AR NED system, we propose a total internal reflection holographic printing method using an index-matching optical frame. As a result, the eye-box of the AR NED is extended in both vertical and horizontal directions and FOV of 50° is achieved at the center of the eye-box. Through the simulations and the experimental results, the feasibility of the proposed method is verified.

Analysis on the reconstruction error of EPISM based full-parallax holographic stereogram and its improvement with multiple reference plane

To reduce the reconstruction error of holographic stereogram fabricated by effective perspective images' segmentation and mosaicking method (EPISM), a multiple-reference-plane (MRP) approach is proposed and validated. The reconstruction error for traditional EPISM is analyzed, and the results indicate that the distortion as well as the blur will be involved for object points located far away from the reference plane. A new method by introducing multiple reference planes is proposed, which divides the 3D scene into several parts along its depth direction, and sets a reference plane for each of the object part. By resynthesizing all the effectively synthetic perspective images referred to their own reference planes of the object parts, the finally effectively synthetic perspective image exposed to one holographic elemental by only once exposure is generated. The optically experimental results demonstrate the validity of the proposed method, and the reconstruction error of full-parallax holographic stereogram printed by MRP based EPISM can be reduced evidently while the displayed depth range of 3D scene can be extended, compared to the traditional EPISM approach.

Holographic Element-Based Effective Perspective Image Segmentation and Mosaicking Holographic Stereogram Printing

Effective perspective image segmentation and mosaicking (EPISM) method is an effective holographic stereogram printing method, but a mosaic misplacement of reconstruction image occurred when focusing away from the reconstruction image plane. In this paper, a method known as holographic element-based effective perspective image segmentation and mosaicking is proposed. Holographic element (hogel) correspondence is used in EPISM method as pixel correspondence is used in direct-writing digital holography (DWDH) method to generate effective perspective images segments. The synthetic perspective image for holographic stereogram printing is obtained by mosaicking all the effective perspective images segments. Optical experiments verified that the holographic stereogram printed by the proposed method can provide high-quality reconstruction imagery and solve the mosaic misplacement inherent in the EPISM method.

Characteristic and improvement on the reconstructed quality of effective perspective images' segmentation and mosaicking-based holographic stereogram

Based on the effective perspective images' segmentation and mosaicking (EPISM) printing method, the influence of the holographic element (hogel) size on the reconstructed quality is analyzed to improve the reconstructed quality of holographic stereogram. The flipping effect and diffraction effect in the spatial domain are also discussed, and the optical transfer function of the holographic stereogram is used in the spectrum domain to evaluate the reconstructed quality. Theoretical analysis and optical experimental results show that the hogel size plays an important role on the flipping effect as well as the clarity of the reconstrued 3D perspective images of the EPISM-based holographic stereogram, and the flipping effect can be improved significantly with optimized hogel size.

Off-axis virtual-image display and camera by holographic mirror and blur compensation

We propose off-axis virtual-image display and camera systems, which integrate a vertically-standing holographic off-axis mirror, blur-compensation optical systems, and digital imaging devices. In the system, the holographic mirror is used for an off-axis reflector, which realizes an upright and thin screen for virtual-image formation. By combining it with a display unit, an off-axis virtual-image display is realized, where the virtual image can be seen behind the upright holographic mirror. Simultaneously, by combining it with a camera unit, an off-axis camera is implemented, which realizes frontal shooting of objects by a camera placed at an off-axis position. Since both the off-axis display and the camera can be implemented by a single holographic mirror, it can be applied to a two-way visual-telecommunication system with a thin screen, which implements eye contact and the observer--image distance. A problem with the proposed system is image blur, which is caused by the chromatic dispersion of the holographic mirror. To solve this, we designed optical blur-compensation systems using a diffractive optical element and a diffuser or a lens. Experimental results verify the concept of the proposed systems with clarifying the effect of designed blur-compensation methods.

Improvement of printing efficiency in holographic stereogram printing with the combination of a field lens and holographic diffuser

In this paper, we use a field lens and a holographic diffuser together to improve the printing efficiency of a holographic stereogram printing system based on the effective perspective images' segmentation and mosaicking method. The light rays' regulation function of the field lens and the modulation function of the holographic diffuser are analyzed. Holographic diffusers with different expanding angles are optimized by numerical simulations and verified by optical experiments. We can achieve a better holographic stereogram reconstruction effect as well as a better printing efficiency when adopting a field lens and a 10° holographic diffuser together. With the proposed method, the energy efficiency can be improved, and the printing time can be reduced greatly.

Characteristic and optimization of the effective perspective images' segmentation and mosaicking (EPISM) based holographic stereogram: an optical transfer function approach

Based on our proposed method for holographic stereogram printing using effective perspective images’ segmentation and mosaicking (EPISM), we analyze the reconstructed wavefront errors, and establish the exit pupil function model of proposed printing system. To evaluate the imaging quality, the optical transfer function (OTF) of the holographic stereogram is modelled from the aspect of frequency response. The characteristic of the OTF with respect to the exit pupil size and the aberration are investigated in detail. We also consider the flipping effect in spatial domain. The optimization of hogel sizes, i.e., the sampling interval of original perspective images and the printing interval of synthetic effective perspective images, are given for the optimized reconstruction. Numerical simulations and optical experiments are implemented, and the results demonstrate the validity of our analysis, and the optimized parameters of hogel sizes can improve the imaging quality of full parallax holographic stereogram effectively.

Method of single-step full parallax synthetic holographic stereogram printing based on effective perspective images' segmentation and mosaicking

With the principle of ray-tracing and the reversibility of light propagation, a new method of single-step full parallax synthetic holographic stereogram printing based on effective perspective images' segmentation and mosaicking (EPISM) is proposed. The perspective images of the scene are first sampled by a virtual camera and the exposing images, which are called synthetic effective perspective images, are achieved using the algorithm of effective perspective images' segmentation and mosaicking according to the propagation law of light and the viewing frustum effect of human eyes. The hogels are exposed using the synthetic effective perspective images in sequence to form the whole holographic stereogram. The influence of modeling parameters on the reconstructed images are also analyzed, and experimental results have demonstrated that the full parallax holographic stereogram printing with the proposed method could provide good reconstructed images by single-step printing. Moreover, detailed experiments with different holographic element sizes, different scene reconstructed distances, and different imaging planes are also analyzed and implemented.

Light-field and holographic three-dimensional displays [Invited]

A perfect three-dimensional (3D) display that satisfies all depth cues in human vision is possible if a light field can be reproduced exactly as it appeared when it emerged from a real object. The light field can be generated based on either light ray or wavefront reconstruction, with the latter known as holography. This paper first provides an overview of the advances of ray-based and wavefront-based 3D display technologies, including integral photography and holography, and the integration of those technologies with digital information systems. Hardcopy displays have already been used in some applications, whereas the electronic display of a light field is under active investigation. Next, a fundamental question in this technology field is addressed: what is the difference between ray-based and wavefront-based methods for light-field 3D displays? In considering this question, it is of particular interest to look at the technology of holographic stereograms. The phase information in holography contributes to the resolution of a reconstructed image, especially for deep 3D images. Moreover, issues facing the electronic display system of light fields are discussed, including the resolution of the spatial light modulator, the computational techniques of holography, and the speckle in holographic images.

Volume holographic printing using unconventional angular multiplexing for three-dimensional display

We propose and demonstrate a volume holographic printing method for dynamic three-dimensional (3D) display with an expanded space-bandwidth product (SBP) using unconventional angular multiplexing techniques. By wavefront encoding of the 3D scene, with the help of computer-generated holography, the object beam is loaded onto a 2D phase spatial light modulator (SLM) with a limited SBP. The printing method then writes a single hologram through the interference of the object beam with a reference beam as a holographic element (hogel) in the volume holographic polymer. In addition, multiple 3D scenes can be recorded and dynamically reconstructed by angular multiplexing in the same hogel location. The SBP can be increased by two orders of magnitude compared to the conventional holographic printing method, showing the potential to realize a dynamic and high-resolution 3D display.

3D touchable holographic light-field display

We propose a new type of 3D user interface: interaction with a light field reproduced by a 3D display. The 3D display used in this work reproduces a 3D light field, and a real image can be reproduced in midair between the display and the user. When using a finger to touch the real image, the light field from the display will scatter. Then, the 3D touch sensing is realized by detecting the scattered light by a color camera. In the experiment, the light-field display is constructed with a holographic screen and a projector; thus, a preliminary implementation of a 3D touch is demonstrated.

Seamless full color holographic printing method based on spatial partitioning of SLM

The holographic wavefront printer decodes the wavefront coming from a three-dimensional object from a computer generated hologram displayed on a spatial light modulator. By recording this wavefront as an analog volume hologram this printing method is highly suitable for realistic color 3D imaging. We propose in the paper spatial partitioning of the spatial light modulator to perform mosaic delivery of exposures at primary colors for seamless reconstruction of a white light viewable color hologram. The method is verified for a 3 × 3 color partitioning scheme by a wavefront printer with demagnification of the light beam diffracted from the modulator.

Numerical reconstruction of a full parallax holographic stereogram with radial distortion

Successful commercialization of holographic printers based on holographic stereograms requires a tool for their numerical replaying and quality assessment before the time-consuming and expensive process of holographic recording. A holographic stereogram encodes 2D images of a 3D scene that are incoherently captured from multiple perspectives and rearranged before recording. This study presents a simulator which builds a full parallax and full color white light viewable holographic stereogram from the perspective images captured by a virtual recentering camera with its further numerical reconstruction for any viewer location. By tracking all steps from acquisition to recording, the simulator allows for analysis of radial distortions caused by the optical elements used at the recording stage. Numerical experiments conducted at increasing degree of pincushion distortion proved its insignificant influence on the reconstructed images in all practical cases by using a peak signal-to-noise ratio and the structural similarity as an image quality metrics.

Resolution enhancement of holographic printer using a hogel overlapping method

We propose a hogel overlapping method for the holographic printer to enhance the lateral resolution of holographic stereograms. The hogel size is directly related to the lateral resolution of the holographic stereogram. Our analysis by computer simulation shows that there is a limit to decreasing the hogel size while printing holographic stereograms. Instead of reducing the size of hogel, the lateral resolution of holographic stereograms can be enhanced by printing overlapped hogels, which makes it possible to take advantage of multiplexing property of the volume hologram. We built a holographic printer, and recorded two holographic stereograms using the conventional and proposed overlapping methods. The images and movies of the holographic stereograms experimentally captured were compared between the conventional and proposed methods. The experimental results confirm that the proposed hogel overlapping method improves the lateral resolution of holographic stereograms compared to the conventional holographic printing method.

Reduction of the recorded speckle noise in holographic 3D printer

A holographic 3D printer produces a high-quality 3D image reproduced by a full-color, full-parallax holographic stereogram with high-density light-ray recording. In order to produce a high-resolution holographic stereogram, we have to solve the problem of speckle noise in this system. For equalizing an intensity distribution inside the elementary hologram, the object beam is modulated by a diffuser. However the diffuser typically generates speckles, which is recorded in the holographic stereogram. It is localized behind the reconstructed image as a granularity noise. First we show the problems of some conventional ways for suppressing the granularity noise using a band-limited diffuser, and then we analyze an approach using a moving diffuser for the reduction of this noise. In the result, it is found that recording with a moving diffuser is effective for reducing the granularity noise at infinity of reconstructed image, although an alternative noise occurs. Moreover we propose a new method introducing multiple exposures to suppress the noise effectively.

Digital color management in full-color holographic three-dimensional printer

We propose a new method of color management for a full-color holographic, three-dimensional (3D) printer, which produces a volume reflection holographic stereogram using red, green, and blue three-color lasers. For natural color management in the holographic 3D printer, we characterize its color reproduction characteristics based on the spectral measurement of reproduced light. Then the color conversion formula, which comprises a one-dimensional lookup table and a 3×3 matrix, was derived from the measurement data. The color reproducibility was evaluated by printing a color chart hologram, and the average CIELAB ΔE=13.19 is fairly small.

Dot-array rainbow hologram

We propose and experimentally demonstrate a novel dot-array recording method in which rainbow holograms are used for the purpose of making hard copies of three-dimensional image data stored in computers.