A Deep Evaluator for Image Retargeting Quality by Geometrical and Contextual Interaction

Image retargeting quality assessment: A survey

With the increasing variety of display devices, image retargeting has become an indispensable technology for adjusting the aspect ratio of images to adapt to different display terminals. Since the retargeting operation would cause geometric distortion and content loss of the image, the image retargeting quality assessment (IRQA) is necessary to guide the retargeting algorithm’s optimization, selection, and design. Our paper mainly works for systematically reviewing the state-of-the-art technologies in IRQA. And then, this paper further discusses image registration algorithms for matching the original image and the retargeted image. Next, we investigate the feature measurement methods for image retargeting quality evaluation. To facilitate the quantitative assessment of the IRQA methods, this paper gives a list of publicly open datasets and the performance of the mainstream methods. Finally, some promising research directions towards IRQA are pointed out. From this survey, engineers from the industry may find skills to improve their image retargeting systems, and researchers from academia may find ideas to conduct some innovative work.

No Reference Quality Assessment for Screen Content Images Using Stacked Autoencoders in Pictorial and Textual Regions

Recently, the visual quality evaluation of screen content images (SCIs) has become an important and timely emerging research theme. This article presents an effective and novel blind quality evaluation metric for SCIs by using stacked autoencoders (SAE) based on pictorial and textual regions. Since the SCI consists of not only the pictorial area but also the textual area, the human visual system (HVS) is not equally sensitive to their different distortion types. First, the textual and pictorial regions can be obtained by dividing an input SCI via an SCI segmentation metric. Next, we extract quality-aware features from the textual region and pictorial region, respectively. Then, two different SAEs are trained via an unsupervised approach for quality-aware features that are extracted from these two regions. After the training procedure of the SAEs, the quality-aware features can evolve into more discriminative and meaningful features. Subsequently, the evolved features and their corresponding subjective scores are input into two regressors for training. Each regressor can obtain one output predictive score. Finally, the final perceptual quality score of a test SCI is computed by these two predicted scores via a weighted model. Experimental results on two public SCI-oriented databases have revealed that the proposed scheme can compare favorably with the existing blind image quality assessment metrics.