Effect of different traversal schemes in integral image coding

Perspective rectification of integral images produced using arrays of circular lenses

There are many different three-dimensional (3D) techniques to capture and deliver autostereoscopic 3D content. A promising technique that provides two-dimensional parallax as well as high-quality, full-color 3D content is integral imaging (InI). Misalignments between the lens arrays (LAs) and the camera charged coupled device, however, introduce geometric distortions in the acquired image that propagate through the different image processing stages and deteriorate the 3D effect. Here, we propose a method to accurately rectify the perspective distortion of integral images (InIms) generated using circular lenses. Using an edge-linking approach, we extracted elliptically shaped contours of elemental images in the perspectively distorted InIm. To calculate the rectification matrix, we used the images of the circular points. Subsequently, we applied a triangulation scheme followed by a statistical approach to accurately estimate the grid structure of the LA. Finally, we provided experimental results over a wide range of InIms to evaluate the robustness and accuracy of the proposed method using objective metrics.

Hierarchical prediction structure for subimage coding and multithreaded parallel implementation in integral imaging

We are concerned with the coding of subimage-transformed elemental images to solve the problems of data transmission and storage in three-dimensional (3D) integral imaging in this paper. First, we use the subimage transform for preprocessing of the elemental image array (EIA). Because of the similarity of correlation distributions between the subimage array (SIA) and multiview video, we present a hierarchical prediction structure for SIA coding based on the hierarchical B picture (HBP) structure for multiview video coding. Moreover, we design a multithreaded parallel implementation for the proposed structure according to inter-row prediction dependencies. Experiments are performed on both EIAs and SIAs. The results show that employing the same coding strategy, the proposed parallel implemented HBP scheme achieves not only higher image quality and better 3D effect but also lower coding delay at low bit rates compared with the previously reported Hilbert-curve-based scheme.

Enhanced three-dimensional discrete cosine transform based compression method for integral images by adaptive three-dimensional block construction

In this paper, we propose an efficient compression method for integral images based on three-dimensional discrete cosine transform (3D-DCT). Even though the existing 3D-DCT based techniques are efficient, they may not be optimized to the characteristics of integral images, such as applying a fixed size block construction and a fixed scanning in placing 2D blocks to construct a 3D block. Therefore, we propose a variable size block construction and a scanning method adaptive to characteristics of integral images, which are realized by adaptive 3D block modes. Experimental results show that the proposed method gives significant improvement in coding efficiency. In particular, at the high bit rates, the proposed method is more improved, since overhead bits for signaling of the 3D block modes take a smaller part of the total bits.

Recent progress in three-dimensional information processing based on integral imaging

Recently developed integral imaging techniques are reviewed. Integral imaging captures and reproduces the light rays from the object space, enabling the acquisition and the display of the three-dimensional information of the object in an efficient way. Continuous effort on integral imaging has been improving the performance of the capture and display process in various aspects, including distortion, resolution, viewing angle, and depth range. Digital data processing of the captured light rays can now visualize the three-dimensional structure of the object with a high degree of freedom and enhanced quality. This recent progress is of high interest for both industrial applications and academic research.

Integral imaging system using an electroluminescent film backlight for three-dimensional-two-dimensional convertibility and a curved structure

We propose a thin and compact integral imaging system using electroluminescent (EL) films as backlight. EL film has the advantage that it can operate continuously even when it is cut or punctured. Using this characteristic, we generate an array of pinholes on EL film to form a point light-source array for reconstructing three-dimensional (3D) images based on integral imaging. The EL pinhole film is attached on another EL film and they are electrically controlled to generate a point light-source array or a surface light source; hence, the system converts between 3D and two-dimensional (2D) modes. Taking advantage of the flexibility of EL films, we also propose a flexible 3D/2D convertible integral imaging system with a wide viewing angle using a curved EL film. We explain the principle of the proposed methods and present experimental results.