Electrically addressed focal stack plenoptic camera based on a liquid-crystal microlens array for all-in-focus imaging

LC-based lightfield camera prototype for rapidly creating target images optimized by finely adjusting several key coefficients and a LC-guided refocusing-rendering

A lightfield camera prototype is constructed by directly coupling a liquid-crystal (LC) microlens array with an arrayed photosensitive sensor for performing a LC-guided refocusing-rendering imaging attached by computing disparity map and extracting featured contours of targets. The proposed camera prototype presents a capability of efficiently selecting the imaging clarity value of the electronic targets interested. Two coefficients of the calibration coefficient k and the rendering coefficient C are defined for quantitively adjusting LC-guided refocusing-rendering operations about the images acquired. A parameter Dp is also introduced for exactly expressing the local disparity of the electronic patterns selected. A parallel computing architecture based on common GPU through the OpenCL platform is adopted for improving the real-time performance of the imaging algorithms proposed, which can effectively be used to extract the pixel-leveled disparity and the featured target contours. In the proposed lightfield imaging strategy, the focusing plane can be easily selected and/or further adjusted by loading and/or varying the signal voltage applied over the LC microlenses for realizing a rapid or even intelligent autofocusing. The research lays a solid foundation for continuously developing or upgrading current lightfield imaging approaches.

End-to-end varifocal multiview images coding framework from data acquisition end to vision application end

The emerging data, varifocal multiview (VFMV) has an exciting prospect in immersive multimedia. However, the distinctive data redundancy of VFMV derived from dense arrangements and blurriness differences among views causes difficulty in data compression. In this paper, we propose an end-to-end coding scheme for VFMV images, which provides a new paradigm for VFMV compression from data acquisition (source) end to vision application end. VFMV acquisition is first conducted in three ways at the source end, including conventional imaging, plenoptic refocusing, and 3D creation. The acquired VFMV has irregular focusing distributions due to varying focal planes, which decreases the similarity among adjacent views. To improve the similarity and the consequent coding efficiency, we rearrange the irregular focusing distributions in descending order and accordingly reorder the horizontal views. Then, the reordered VFMV images are scanned and concatenated as video sequences. We propose 4-directional prediction (4DP) to compress the reordered VFMV video sequences. Four most similar adjacent views from the left, upper left, upper and upper right directions serve as reference frames to improve the prediction efficiency. Finally, the compressed VFMV is transmitted and decoded at the application end, benefiting potential vision applications. Extensive experiments demonstrate that the proposed coding scheme is superior to the comparison scheme in objective quality, subjective quality and computational complexity. Experiments on new view synthesis show that VFMV can achieve extended depth of field than conventional multiview at the application end. Validation experiments show the effectiveness of view reordering, the advantage over typical MV-HEVC, and the flexibility on other data types, respectively.