Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation

Reduced-reference stereoscopic image quality assessment (RRSIQA) models evaluate stereoscopic image quality degradation with partial information about the “ideal-quality” reference stereopair. On one hand, sparse representation in recent theoretical studies of visual cognition...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Jian Ma, Guoming Xu, Xiyu Han
Formato: article
Lenguaje:EN
Publicado: IEEE 2021
Materias:
Acceso en línea:https://doaj.org/article/1a8d0b72c42a418185a34ab5eb79ea4e
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:1a8d0b72c42a418185a34ab5eb79ea4e
record_format dspace
spelling oai:doaj.org-article:1a8d0b72c42a418185a34ab5eb79ea4e2021-12-02T00:00:34ZReduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation2169-353610.1109/ACCESS.2021.3129814https://doaj.org/article/1a8d0b72c42a418185a34ab5eb79ea4e2021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9623456/https://doaj.org/toc/2169-3536Reduced-reference stereoscopic image quality assessment (RRSIQA) models evaluate stereoscopic image quality degradation with partial information about the “ideal-quality” reference stereopair. On one hand, sparse representation in recent theoretical studies of visual cognition has been proved to resemble the strategy used to represent natural images in the primary visual cortex. On the other hand, the joint statistics of gradient magnitude (GM) and Laplacian of Gaussian (LOG) features are popularly utilized to form image semantic structures. Motivated by these findings, we present a new RRSIQA metric using gradient sparse representation and structural degradation in this paper. Concretely, the proposed metric is based on two main tasks: the first task extracts the distribution statistics of visual primitives by gradient sparse representation, while the second task measures structural degradation of stereoscopic image due to the presence of distortion by extracting the joint statistics of GM and LOG features. The former, so-called the binocular perceptual visual information (PVI), aims to effectively integrates the gradient map that is sparser than the image itself. Especially, the process of binocular fusion is simulated by using the mutual information of the gradient-based visual primitives between left and right view’s images as binocular cue. Furthermore, the perceptual loss vectors are taken as the differences of binocular perceptual visual information and structural degradation between reference and distorted stereopairs. Finally, the perceptual loss vectors are utilized to calculate the quality score by a prediction function which is trained using kernel ridge regressing (KRR). The experiments are performed on the popular LIVE 3D IQA databases and Waterloo IVC 3D databases, and experimental results show highly competitive performance with the state-of-the-art algorithms. Moreover, in some challenging cases with particular asymmetric distortion types, the proposed metric can achieves the best quality prediction accuracy in LIVE 3D phase II and Waterloo IVC 3D Phase II.Jian MaGuoming XuXiyu HanIEEEarticleReduced-referencestereoscopic image quality assessmentsparse representationstructural degradationkernel ridge regressingElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENIEEE Access, Vol 9, Pp 157134-157150 (2021)
institution DOAJ
collection DOAJ
language EN
topic Reduced-reference
stereoscopic image quality assessment
sparse representation
structural degradation
kernel ridge regressing
Electrical engineering. Electronics. Nuclear engineering
TK1-9971
spellingShingle Reduced-reference
stereoscopic image quality assessment
sparse representation
structural degradation
kernel ridge regressing
Electrical engineering. Electronics. Nuclear engineering
TK1-9971
Jian Ma
Guoming Xu
Xiyu Han
Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
description Reduced-reference stereoscopic image quality assessment (RRSIQA) models evaluate stereoscopic image quality degradation with partial information about the “ideal-quality” reference stereopair. On one hand, sparse representation in recent theoretical studies of visual cognition has been proved to resemble the strategy used to represent natural images in the primary visual cortex. On the other hand, the joint statistics of gradient magnitude (GM) and Laplacian of Gaussian (LOG) features are popularly utilized to form image semantic structures. Motivated by these findings, we present a new RRSIQA metric using gradient sparse representation and structural degradation in this paper. Concretely, the proposed metric is based on two main tasks: the first task extracts the distribution statistics of visual primitives by gradient sparse representation, while the second task measures structural degradation of stereoscopic image due to the presence of distortion by extracting the joint statistics of GM and LOG features. The former, so-called the binocular perceptual visual information (PVI), aims to effectively integrates the gradient map that is sparser than the image itself. Especially, the process of binocular fusion is simulated by using the mutual information of the gradient-based visual primitives between left and right view’s images as binocular cue. Furthermore, the perceptual loss vectors are taken as the differences of binocular perceptual visual information and structural degradation between reference and distorted stereopairs. Finally, the perceptual loss vectors are utilized to calculate the quality score by a prediction function which is trained using kernel ridge regressing (KRR). The experiments are performed on the popular LIVE 3D IQA databases and Waterloo IVC 3D databases, and experimental results show highly competitive performance with the state-of-the-art algorithms. Moreover, in some challenging cases with particular asymmetric distortion types, the proposed metric can achieves the best quality prediction accuracy in LIVE 3D phase II and Waterloo IVC 3D Phase II.
format article
author Jian Ma
Guoming Xu
Xiyu Han
author_facet Jian Ma
Guoming Xu
Xiyu Han
author_sort Jian Ma
title Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
title_short Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
title_full Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
title_fullStr Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
title_full_unstemmed Reduced-Reference Stereoscopic Image Quality Assessment Using Gradient Sparse Representation and Structural Degradation
title_sort reduced-reference stereoscopic image quality assessment using gradient sparse representation and structural degradation
publisher IEEE
publishDate 2021
url https://doaj.org/article/1a8d0b72c42a418185a34ab5eb79ea4e
work_keys_str_mv AT jianma reducedreferencestereoscopicimagequalityassessmentusinggradientsparserepresentationandstructuraldegradation
AT guomingxu reducedreferencestereoscopicimagequalityassessmentusinggradientsparserepresentationandstructuraldegradation
AT xiyuhan reducedreferencestereoscopicimagequalityassessmentusinggradientsparserepresentationandstructuraldegradation
_version_ 1718403969244463104