The modulation function and realizing method of holographic functional screen

Crosstalk Suppressed 3D Light Field Display Based on an Optimized Holographic Function Screen

A holographic function screen (HFS) can recompose the wavefront and re-modulate the light-field distribution from a three-dimensional (3D) light field display (LFD) system. However, the spread function of existing HFSs does not particularly suit integral imaging (II) 3D LFD systems, which causes crosstalk and reduces the sharpness of reconstructed 3D images. An optimized holographic function screen with a flat-top rectangular spread function (FRSF) was designed for an II 3D LFD system. A simulation was carried out through ray tracing, which verified that the proposed diffusion function could suppress crosstalk and improve the overall effect.

Automatic co-design of light field display system based on simulated annealing algorithm and visual simulation

Accurate, fast, and reliable modeling and optimization methods play a crucial role in designing light field display (LFD) system. Here, an automatic co-design method of LFD system based on simulated annealing and visual simulation is proposed. The process of LFD content acquisition and optical reconstruction are modeled and simulated, the objective function for evaluating the display effect of the LFD system is established according to the simulation results. In case of maximum objective function, the simulated annealing optimization method is used to find the optimal parameters of the LFD system. The validity of the proposed method is confirmed through optical experiments.

3D light-field display with an increased viewing angle and optimized viewpoint distribution based on a ladder compound lenticular lens unit

Three-dimensional (3D) light-field displays (LFDs) suffer from a narrow viewing angle, limited depth range, and low spatial information capacity, which limit their diversified application. Because the number of pixels used to construct 3D spatial information is limited, increasing the viewing angle reduces the viewpoint density, which degrades the 3D performance. A solution based on a holographic functional screen (HFS) and a ladder-compound lenticular lens unit (LC-LLU) is proposed to increase the viewing angle while optimizing the viewpoint utilization. The LC-LLU and HFS are used to create 160 non-uniformly distributed viewpoints with low crosstalk, which increases the viewpoint density in the middle viewing zone and provides clear monocular depth cues. The corresponding coding method is presented as well. The optimized compound lenticular lens array can balance between suppressing aberration and improving displayed quality. The simulations and experiments show that the proposed 3D LFD can present natural 3D images with the right perception and occlusion relationship within a 65° viewing angle.

Aberration correction based on a pre-correction convolutional neural network for light-field displays

Lens aberrations degrade the image quality and limit the viewing angle of light-field displays. In the present study, an approach to aberration reduction based on a pre-correction convolutional neural network (CNN) is demonstrated. The pre-correction CNN is employed to transform the elemental image array (EIA) generated by a virtual camera array into a pre-corrected EIA (PEIA). The pre-correction CNN is built and trained based on the aberrations of the lens array. The resulting PEIA, rather than the EIA, is presented on the liquid crystal display. Via the optical transformation of the lens array, higher quality 3D images are obtained. The validity of the proposed method is confirmed through simulations and optical experiments. A 70-degree viewing angle light field display with the improved image quality is demonstrated.

Space-division-multiplexed catadioptric integrated backlight and symmetrical triplet-compound lenticular array based on ORM criterion for 90-degree viewing angle and low-crosstalk directional backlight 3D light-field display

A novel optical reverse mapping (ORM) method and an ORM criterion are proposed to evaluate the relevance between the directional backlight (DB) 3D light-field display system aberration and the crosstalk. Based on the ORM criterion, the space-division-multiplexed catadioptric integrated backlight (SCIB) and symmetrical triplet-compound lenticular array (triplet LA) are designed. The SCIB is composed of hybrid Fresnel integrated backlight unit (hybrid Fresnel unit) and space-division-multiplexed microprism unit (microprism unit). The hybrid Fresnel unit is used to provide the directional light, and the divergence angle is 2.4-degrees. The average uniformity of 83.02% is achieved. The microprism unit is used to modulate the directional light distribution into three predetermined directions to establish a 90-degree viewing area. Combined with SCIB, the triplet LA is used to suppress the aberrations and reduce the crosstalk. In the experiment, a DB 3D light-field display system based on SCIB and triplet LA is set up. The displayed light-field 3D image can be observed in a 90-degree viewing angle. Compared to the conventional DB 3D display system, the light-field 3D image is aberration-suppressed, and the SSIM values are improved from 0.8462 to 0.9618. Meanwhile, the crosstalk measurement results show that the average crosstalk is 3.49%. The minimum crosstalk is 2.31% and the maximum crosstalk is 4.52%. The crosstalk values in 90-degree are lower than 5%.

Wave-optics and spatial frequency analyses of integral imaging three-dimensional display systems

Wave optics is usually thought to be more rigorous than geometrical optics to analyze integral imaging (II) systems. However, most of the previous wave-optics investigations are directed to a certain subsystem or do not sufficiently consider the finite aperture of microlens arrays (MLAs). Therefore, a diffraction-limited model of the entire II system, which consists of pickup, image processing, and reconstruction subsystems, is proposed, and the effects of system parameters on spatial resolution are especially studied. With the help of paraxial scalar diffraction theory, the origin impulse response function of the entire II system is derived; the parameter matching condition with optimum resolution and the wave-optics principle are achieved. Besides, the modulation transfer function is then obtained and Fourier analysis is performed, which indicates that the features of MLA and the display play a critical role in spatial frequency transfer characteristics, greatly affecting the resolution. These studies might be useful for the further research and understanding of II systems, especially for the effective enhancement of resolution.

Design, characterization, and fabrication of 90-degree viewing angle catadioptric retroreflector floating device using in 3D floating light-field display system

A novel catadioptric retroreflector floating device (CRA) used in the 3D floating light-field system is proposed. The floating light-field image constructed by the CRA is aberration-suppressed. The luminance and the contrast of the image are substantially improved in a 90-degree viewing angle. The CRA is constituted of the designed catadioptric retroreflector (CR). The CR consists of three lenses, the first and the second lens is to refract the light, and the rear surface of the third lens is coated with reflective coating in order to reflect the incident light. The CRA is processable and the fabrication process using UV embossing is also described. A spectrophotometer is utilized to measure the retroreflective efficiency of the CRA. The average retroreflective efficiency of the CRA is 80.1%. A beam quality analyzer is utilized to measure the beam spot quality of the CRA, and the image quality can satisfy the requirements of human eye observation. In the experiment, compared to the floating light-field image constructed by the micro-beads type retroreflector floating device (MRA), the image quality of the floating light-field image constructed by the CRA is significantly enhanced. In the quantitative computer simulation, the PSNR values of the images are increased from 23.0185 to 32.1958.

Holographic display method with a large field of view based on a holographic functional screen

In this paper, we propose a method to increase the field of view (FOV) in a holographic display. Different from the traditional method, a large-sized computer-generated hologram (CGH) is generated, and a holographic function screen is used in the proposed method. The CGH is formed by superposition of interference fringes. The diffraction boundary angle of the interferogram is set to be equal to the maximum diffraction angle of the reconstructed light. In the holographic reconstruction, three spatial light modulators (SLMs) arranged side by side in a linear configuration are used to load the CGH. The holographic functional screen is used for eliminating the seams between the SLMs and further enlarging the diffraction light. With the proposed method, the reconstructed light after each image point is expanded, so that the FOV can be increased effectively. Experimental results prove the feasibility of the proposed method.

Enhancing integral imaging performance using time-multiplexed convergent backlight

A method to enhance the performance of an integral imaging system is demonstrated using the time-multiplexed convergent backlight technique. The backlight increases the space bandwidth of the integral imaging system. As a result, the resolution, depth of field, and viewing angle of the integral imaging system are increased simultaneously. The cross-talk noise is also decreased without using any optical barrier. One part of the added space bandwidth comes from the optimized illumination. The other part is converted from the time bandwidth of the system by time-multiplexing. The time-multiplexed convergent backlight modulates the direction of the backlight in time sequence to illuminate the elemental images. Then, the elemental images synthesize the 3D images using a microlens array. An elemental images rendering method using a conjugate pinhole camera and pinhole projector model is designed to dynamically match the illumination direction. The rendering method eliminates the distortion and maximizes the viewing angle and viewing zone. A field programmable gate array (FPGA)-based controller is used to manage and synchronize the time sequence of the backlight and the display devices. Using this technique, high-performance 3D images are realized. Comparison experiments of the integral imaging system using diffused backlight and convergent backlight are performed. The results show the effectiveness of the proposed technique.

Bionic-compound-eye structure for realizing a compact integral imaging 3D display in a cell phone with enhanced performance

A bionic-compound-eye structure (BCES), which is a substitute of a microlens array, is proposed to enhance the performance of integral imaging (II) 3D display systems. Hexagonal ocelli without gaps and barriers are predesigned to obtain a continuous image, high-resolution, and uniform parallax. A curved substrate is designed to enhance the viewing angle. In addition, ocelli are fused with the substrate to form a relief structure, BCES. When they are placed above a normal display, continuous and full-parallax 3D images with 150 µm effective resolution and a 28° horizontal, 22° vertical viewing angle could be achieved, about twice as much as that of normal systems. The weight of the BCES is 31 g, and the thickness of the whole system is 22 mm; thus, the BCES-based II (BCES-II) is very compact. In addition, this structure can be easily integrated into a cell phone or iPad for compact quasi-2D and 3D adjustable display.

2D/3D mixed display based on integral imaging and a switchable diffuser element

In this paper, we present a 2D/3D mixed system with high image quality based on integral imaging and a switchable diffuser element. The proposed system comprises a liquid crystal display screen, lens array, switchable diffuser element and projector. The switchable diffuser element can be controlled to present 2D/3D mixed images or 2D and 3D images independently, and can reduce the Moire fringe and black grid. In addition to the improved display quality, the proposed system has advantages of a simple structure and is low cost, which contribute to the portability and practicability.

Time-multiplexed light field display with 120-degree wide viewing angle

The light field display can provide vivid and natural 3D performance, which can find many applications, such as relics research and exhibition. However, current light field displays are constrained by the viewing angle, which cannot meet the expectations. With three groups directional backlights and a fast-switching LCD panel, a time-multiplexed light field display with a 120-degree wide viewing angle is demonstrated. Up to 192 views are constructed within the viewing range to ensure the right geometric occlusion and smooth parallax motion. Clear 3D images can be perceived at the entire range of viewing angle. Additionally, the designed holographic functional screen is used to recompose the light distribution and the compound aspheric lens array is optimized to balance the aberrations and improve the 3D display quality. Experimental results verify that the proposed light field display has the capability to present realistic 3D images of historical relics in 120-degree wide viewing angle.

Demonstration of a low-crosstalk super multi-view light field display with natural depth cues and smooth motion parallax

Due to lack of the accommodation stimulus, an inherent drawback for the conventional glasses-free stereoscopic display is that precise depth cues for the human monocular vision is rent, which results in the well-known convergence-accommodation conflict for the human visual system. Here, a super multi-view light field display with the vertically-collimated programmable directional backlight (VC-PDB) and the light control module (LCM) is demonstrated. The VC-PDB and the LCM are used to form the super multi-view light field display with low crosstalk, which can provide precisely detectable accommodation depth for human monocular vision. Meanwhile, the VC-PDB cooperates with the refreshable liquid-crystal display panel to provide the convergence depth matching the accommodation depth. In addition, the proposed method of light field pick-up and reconstruction is implemented to ensure the perceived three dimensional (3D) images with accurate depth cues and correct geometric occlusion, and the eye tracker is used to enlarge the viewing angle of 3D images with smooth motion parallax. In the experiments, the reconstructed high quality fatigue-free 3D images can be perceived with the clear focus depth of 13 cm in the viewing angle of ± 20°, where 352 viewpoints with the viewpoint density of 1 mm^-1 and the crosstalk of less than 6% are presented.

A flipping-free 3D integral imaging display using a twice-imaging lens array

Integral imaging is a promising 3D visualization technique for reconstructing 3D medical scenes to enhance medical analysis and diagnosis. However, the use of lens arrays inevitably introduces flipped images beyond the field of view, which cannot reproduce the correct parallax relation. To avoid the flipping effect in optical reconstruction, a twice-imaging lens array based integral display is presented. The proposed lens arrangement, which consists of a light-controlling lens array, a field lens array and an imaging lens array, allows the light rays from each elemental image only pass through its corresponding lens unit. The lens arrangement is optimized with geometrical optics method, and the proposed display system is experimentally demonstrated. A full-parallax 3D medical scene showing continuous viewpoint information without flipping is reconstructed in 45° field of view.

360-degree tabletop 3D light-field display with ring-shaped viewing range based on aspheric conical lens array

When employing the light field method with standard lens array and the holographic functional screen (HFS) to realize the tabletop three-dimensional (3D) display, the viewing area of the reconstructed 3D images is right above the screen. As the observers sit around the table, the generated viewpoints in the middle of the viewing area are wasteful. Here, a 360-degree viewable light-field display system is demonstrated, which can present 3D images to multiple viewers in ring-shaped viewing range. The proposed display system consists of the HFS, the aspheric conical lens array, a 27-inch LCD with the resolution of 3840×2160, the LEDs array and the Fresnel lens array. By designing the aspheric conical lens, the light rays emitting from the elemental images forms the viewpoints in a ring-type arrangement. And the corresponding coding method is given. Compared with the light field display with standard lens array, the viewpoint density is increased and the aliasing phenomenon is reduced. In the experiment, the tabletop light-field display based on aspheric conical lens array can present high quality 360-degree viewable 3D image with the right perception and occlusion.

Dual-View Integral Imaging 3D Display Based on Multiplexed Lens-Array Holographic Optical Element

We propose a dual-view integral imaging 3D display based on a multiplexed lens-array holographic optical element (MHOE). A MHOE is a volume holographic optical element obtained by multiplexing technology, which can be used for dual-view integral imaging 3D display due to the angle selectivity of the volume HOE. In the fabrication of the MHOE, two spherical wavefront arrays with different incident angles are recorded using photopolymer material. In the reconstruction, two projectors are used to project the elemental image arrays (EIA) with corresponding angles for two viewing zones. We have developed a prototype of the dual-view integral imaging display. The experimental results demonstrate the correctness of the theory.

Viewing-angle and viewing-resolution enhanced integral imaging based on time-multiplexed lens stitching

A method for the viewing angle and viewing resolution enhancement of integral imaging (InIm) based on time-multiplexed lens stitching is demonstrated using the directional time-sequential backlight (DTS-BL) and the compound lens-array. In order to increase the lens-pitch of the compound lens-array for enlarging the viewing angle of InIm, DTS-BL is used to continuously stitch the adjacent elemental lenses in the time-multiplexed way. Through the compound lens-array with two pieces of lens in each lens unit, the parallel light beams from the DTS-BL converge and form a uniformly distributed dense point light source array (PLSA). Light rays emitting from the PLSA are modulated by the liquid crystal display (LCD) panel and then integrated as volumetric pixels of the reconstructed three-dimensional (3D) image. Meanwhile, time-multiplexed generation of the point light sources (PLSs) in the array is realized by time-multiplexed lens stitching implemented with the DTS-BL. As a result, the number of the PLSs, as the pixels of the perceived 3D image, is increased and then the viewing resolution of the 3D image is obviously enhanced. Additionally, joint optical optimization for the DTS-BL and the compound lens-array is used for suppressing the aberrations, and the imaging distortion can be decreased to 0.23% from 5.80%. In the experiment, a floating full-parallax 3D light-field image can be perceived with 4 times the viewing resolution enhancement in the viewing angle of 50°, where 7056 viewpoints are presented.

A crosstalk-suppressed dense multi-view light-field display based on real-time light-field pickup and reconstruction

A crosstalk-suppressed dense multi-view light-field display based on real-time light-field pickup and reconstruction is demonstrated, which is capable of realizing high view density in the horizontal direction with low crosstalk between micro-pitch viewing zones. The micro-pinhole unit array and the vertically-collimated backlight are specially developed and used, instead of refraction-based optical components like lenticular lens, to avoid aberrations and to suppress crosstalk for accurately projecting multiple view perspectives into each eye pupil of the viewer. Additionally, the spatial information entropy is defined and investigated to improve 3D image perception for balancing resolution, which can be generally applicable to better-reconstructed 3D images with the limited number of resolution pixels. To enlarge the viewing angle of 3D images with smooth motion parallax, the novel high-efficient light-field pickup and reconstruction method based on the real-time position of the viewer's pupils is implemented with an eye tracker to scan 750 view perspectives with the correct geometric occlusion in real time at the frame rate of 40 fps. In the experiment, a floating horizontal-parallax 3D light-field image with the view density of 0.75 mm^-1 and the micro-pitch crosstalk of less than 7% can be perceived with the clear floating focus depth of 10 cm and the high resolution of 1920 × 1080 in the viewing angle of 70°.

162-inch 3D light field display based on aspheric lens array and holographic functional screen

Large-scale three-dimensional (3D) display can evoke a great sense of true presence and immersion. Nowadays, most of the large-scale autostereoscopic displays are based on parallax barrier with view zone jumping, which also sacrifices much brightness and leads to uneven illumination. With a 3840 × 2160 LED panel, a large-scale horizontal light field display based on aspheric lens array (ALA) and holographic functional screen (HFS) is demonstrated, which can display high quality 3D image. The HFS recomposes the light distribution, while the ALA improves the quantity of perspective information in a horizontal direction by using vertical pixels and it can suppress the aberration that is mainly caused by marginal light rays. The 162-inch horizontal light field display can reconstruct 3D images with the depth range of 1.5 m within the viewing angle of 40°. The feasibility of the proposed display method is verified by the experimental results.

Wavefront aberration correction for integral imaging with the pre-filtering function array

In integral imaging, the quality of a reconstructed image degrades with increasing viewing angle due to the wavefront aberrations introduced by the lens-array. A wavefront aberration correction method is proposed to enhance the image quality with a pre-filtering function array (PFA). To derive the PFA for an integral imaging display, the wavefront aberration characteristic of the lens-array is analyzed and the intensity distribution of the reconstructed image is calculated based on the wave optics theory. The minimum mean square error method is applied to manipulate the elemental image array (EIA) with a PFA. The validity of the proposed method is confirmed through simulations as well as optical experiments. A 45-degree viewing angle integral imaging display with enhanced image quality is achieved.

Improvement of printing efficiency in holographic stereogram printing with the combination of a field lens and holographic diffuser

In this paper, we use a field lens and a holographic diffuser together to improve the printing efficiency of a holographic stereogram printing system based on the effective perspective images' segmentation and mosaicking method. The light rays' regulation function of the field lens and the modulation function of the holographic diffuser are analyzed. Holographic diffusers with different expanding angles are optimized by numerical simulations and verified by optical experiments. We can achieve a better holographic stereogram reconstruction effect as well as a better printing efficiency when adopting a field lens and a 10° holographic diffuser together. With the proposed method, the energy efficiency can be improved, and the printing time can be reduced greatly.

Aberration analyses for improving the frontal projection three-dimensional display

The crosstalk severely affects the viewing experience for the auto-stereoscopic 3D displays based on frontal projection lenticular sheet. To suppress unclear stereo vision and ghosts are observed in marginal viewing zones(MVZs), aberration of the lenticular sheet combining with the frontal projector is analyzed and designed. Theoretical and experimental results show that increasing radius of curvature (ROC) or decreasing aperture of the lenticular sheet can suppress the aberration and reduce the crosstalk. A projector array with 20 micro-projectors is used to frontally project 20 parallax images one lenticular sheet with the ROC of 10 mm and the size of 1.9 m × 1.2 m. The 3D image with the high quality is experimentally demonstrated in both the mid-viewing zone and MVZs in the optimal viewing plane. The 3D clear depth of 1.2m can be perceived. To provide an excellent 3D image and enlarge the field of view at the same time, a novel structure of lenticular sheet is presented to reduce aberration, and the crosstalk is well suppressed.