High-resolution Fourier hologram synthesis from photographic images through computing the light field

Accelerating hologram generation using oriented-separable convolution and wavefront recording planes

Recently, holographic displays have gained attention owing to their natural presentation of three-dimensional (3D) images; however, the enormous amount of computation has hindered their applicability. This study proposes an oriented-separable convolution accelerated using the wavefront-recording plane (WRP) method and recurrence formulas. We discuss the orientation of 3D objects that affects computational efficiency, which is overcome by reconsidering the orientation, and the suitability of the proposed method for hardware implementations.

Three-dimensional computer holography enabled from a single 2D image

To compute a high-quality computer-generated hologram (CGH) for true 3D real scenes, a huge amount of 3D data must be physically acquired and provided depending on specific devices or 3D rendering techniques. Here, we propose a computational framework for generating a CGH from a single image based on the idea of 2D-to-3D wavefront conversion. We devise a deep view synthesis neural network to synthesize light-field contents from a single image and convert the light-field data to the diffractive wavefront of the hologram using a ray-wave algorithm. The method is able to achieve extremely straightforward 3D CGH generation from hand-accessible 2D image content and outperforms existing real-world-based CGH computation, which inevitably relies on a high-cost depth camera and cumbersome 3D data rendering. We experimentally demonstrate 3D reconstructions of indoor and outdoor scenes from a single image enabled phase-only CGH.

Implementation of full-color holographic system using non-uniformly sampled 2D images and compressed point cloud gridding

A multiple-camera holographic system using non-uniformly sampled 2D images and compressed point cloud gridding (C-PCG) is suggested. High-quality, digital single-lens reflex cameras are used to acquire the depth and color information from real scenes; these are then virtually reconstructed by the uniform point cloud using a non-uniform sampling method. The C-PCG method is proposed to generate efficient depth grids by classifying groups of object points with the same depth values in the red, green, and blue channels. Holograms are obtained by applying fast Fourier transform diffraction calculations to the grids. Compared to wave-front recording plane methods, the quality of the reconstructed images is substantially better, and the computational complexity is dramatically reduced. The feasibility of our method is confirmed both numerically and optically.

Light field reconstruction with randomly shot photographs

Light field imaging is a promising technique for recording and displaying three-dimensional (3D) scenes. Light field reconstruction using a conventional camera, instead of a lens-array-based plenoptic camera, is expected to have a higher resolution. However, in existing conventional-camera-based methods, the camera placement is restricted. In this paper, we propose a new flexible light field reconstruction method involving shooting using a conventional camera from random 3D positions and angles. The proposed method has the advantage of flexibility because it uses a conventional camera, and the shooting position and angle can be selected randomly. Such flexibility is expected to give it a wide range of applications.

Orthographic projection images-based photon-counted integral Fourier holography

Unlike coherent imaging techniques, light field imaging uses incoherent (white light) illumination to generate a digital hologram of three-dimensional (3D) objects in real time. Multiple projections (or elemental images) of a 3D object are captured using a microlens array attached to a digital camera. Orthographic projection images (OPIs) can be synthesized from the recorded elemental images. The synthesized intensity-based OPIs are then multiplied by the corresponding phase functions and combined to form a digital hologram (also known as an integral hologram) of a 3D object under illumination. In this study, we analyze the performance of a synthesized integral hologram under low light imaging (photon-counting) conditions. The feasibility of this technique is verified experimentally by capturing the elemental images and subsequently generating orthographic projection images and by varying photon counts to reconstruct the digital holograms.

3D Imaging Based on Depth Measurement Technologies

Three-dimensional (3D) imaging has attracted more and more interest because of its widespread applications, especially in information and life science. These techniques can be broadly divided into two types: ray-based and wavefront-based 3D imaging. Issues such as imaging quality and system complexity of these techniques limit the applications significantly, and therefore many investigations have focused on 3D imaging from depth measurements. This paper presents an overview of 3D imaging from depth measurements, and provides a summary of the connection between the ray-based and wavefront-based 3D imaging techniques.

Quality enhancement and GPU acceleration for a full-color holographic system using a relocated point cloud gridding method

The calculation of realistic full-color holographic displays is hindered by the high computational cost. Previously, we suggested a point cloud gridding (PCG) method to calculate monochrome holograms of real objects. In this research, a relocated point cloud gridding (R-PCG) method is proposed to enhance the reconstruction quality and accelerate the calculation speed in GPU for a full-color holographic system. We use a depth camera to acquire depth and color information from the real scene then reconstruct the point cloud model virtually. The R-PCG method allows us to classify groups of object points with the same depth values into grids in the red, green, and blue (RGB) channels. Computer-generated holograms (CGHs) are obtained by applying a fast Fourier transform (FFT) diffraction calculation to the grids. The feasibility of the R-PCG method is confirmed by numerical and optical reconstruction.

Full-color digitized holography for large-scale holographic 3D imaging of physical and nonphysical objects

Digitized holography techniques are used to reconstruct three-dimensional (3D) images of physical objects using large-scale computer-generated holograms (CGHs). The object field is captured at three wavelengths over a wide area at high densities. Synthetic aperture techniques using single sensors are used for image capture in phase-shifting digital holography. The captured object field is incorporated into a virtual 3D scene that includes nonphysical objects, e.g., polygon-meshed CG models. The synthetic object field is optically reconstructed as a large-scale full-color CGH using red-green-blue color filters. The CGH has a wide full-parallax viewing zone and reconstructs a deep 3D scene with natural motion parallax.

Fast and high-resolution light field acquisition using defocus modulation

In the conventional microlens-array-based light field imaging system, there is a trade-off between the angular and spatial resolutions. Light field reconstruction from images captured by focal plane sweeping, such as light field moment imaging (LFMI) and light field reconstruction with back projection (LFBP), can achieve high transverse resolution comparable to the modern camera sensor. However, the acquisition of a series of focal plane sweeping images along the optical axis is time consuming and requires fine alignment. Furthermore, different focal-plane-based light field reconstruction techniques require images with different characteristics. To solve these problems, we present an efficient approach for fast light field acquisition with precise focal plane sweeping capture by defocus modulation, rather than mechanical movement. Also, we verify the validity and the improvement of our system. With the controllable point spread function, we can capture images for light field reconstruction with both LFMI and LFBP. Otherwise, we quantitatively compare the two methods using images captured with the proposed systems.

Analysis of the noise in backprojection light field acquisition and its optimization

Light field reconstruction from images captured by focal plane sweeping can achieve high lateral resolution comparable to the modern camera sensor. This is impossible for the conventional micro-lenslet-based light field capture systems. However, the severe defocus noise and the low depth resolution limit its applications. In this paper, we analyze the defocus noise in the focal-plane-sweeping-based light field reconstruction technique, and propose a method to reduce the defocus noise. Both numerical and experimental results verify the proposed method.