Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing

In real video coding systems, there might be pre-processing before the encoding and post-processing after the decoding. Those pre- and post-processing should be jointly optimized considering the existing of distortions introduced by lossy coding in between. This paper proposes a differentiable netwo...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Kaitian Qiu, Lu Yu, Daowen Li
Formato:	article
Lenguaje:	EN
Publicado:	IEEE 2021
Materias:	codec-simulation pre- /post-processing down-sampling super-resolution HEVC Electric apparatus and materials. Electric circuits. Electric networks TK452-454.4
Acceso en línea:	https://doaj.org/article/3aa39bfac87b483d9965e12056f94774
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:3aa39bfac87b483d9965e12056f94774
record_format	dspace
spelling	oai:doaj.org-article:3aa39bfac87b483d9965e12056f947742021-11-23T00:02:24ZCodec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing2644-122510.1109/OJCAS.2021.3124243https://doaj.org/article/3aa39bfac87b483d9965e12056f947742021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9623352/https://doaj.org/toc/2644-1225In real video coding systems, there might be pre-processing before the encoding and post-processing after the decoding. Those pre- and post-processing should be jointly optimized considering the existing of distortions introduced by lossy coding in between. This paper proposes a differentiable network to simulate the non-differentiable traditional coding to make the joint optimization of pre- and post-processing possible. The proposed codec-simulation network can achieve up to 49.4dB simulation accuracy for HEVC codec in intra mode. When we use down-sampling and up-sampling as examples of pre- and post-processing of a video codec, the joint optimization of these two processing modules in a video coding system can result in 46.88% and 55.15% BD-rate reduction based on PSNR and SSIM compared with that without joint optimization.Kaitian QiuLu YuDaowen LiIEEEarticlecodec-simulationpre- /post-processingdown-samplingsuper-resolutionHEVCElectric apparatus and materials. Electric circuits. Electric networksTK452-454.4ENIEEE Open Journal of Circuits and Systems, Vol 2, Pp 648-659 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	codec-simulation pre- /post-processing down-sampling super-resolution HEVC Electric apparatus and materials. Electric circuits. Electric networks TK452-454.4
spellingShingle	codec-simulation pre- /post-processing down-sampling super-resolution HEVC Electric apparatus and materials. Electric circuits. Electric networks TK452-454.4 Kaitian Qiu Lu Yu Daowen Li Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
description	In real video coding systems, there might be pre-processing before the encoding and post-processing after the decoding. Those pre- and post-processing should be jointly optimized considering the existing of distortions introduced by lossy coding in between. This paper proposes a differentiable network to simulate the non-differentiable traditional coding to make the joint optimization of pre- and post-processing possible. The proposed codec-simulation network can achieve up to 49.4dB simulation accuracy for HEVC codec in intra mode. When we use down-sampling and up-sampling as examples of pre- and post-processing of a video codec, the joint optimization of these two processing modules in a video coding system can result in 46.88% and 55.15% BD-rate reduction based on PSNR and SSIM compared with that without joint optimization.
format	article
author	Kaitian Qiu Lu Yu Daowen Li
author_facet	Kaitian Qiu Lu Yu Daowen Li
author_sort	Kaitian Qiu
title	Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
title_short	Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
title_full	Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
title_fullStr	Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
title_full_unstemmed	Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing
title_sort	codec-simulation network for joint optimization of video coding with pre- and post-processing
publisher	IEEE
publishDate	2021
url	https://doaj.org/article/3aa39bfac87b483d9965e12056f94774
work_keys_str_mv	AT kaitianqiu codecsimulationnetworkforjointoptimizationofvideocodingwithpreandpostprocessing AT luyu codecsimulationnetworkforjointoptimizationofvideocodingwithpreandpostprocessing AT daowenli codecsimulationnetworkforjointoptimizationofvideocodingwithpreandpostprocessing
_version_	1718417368800034816

Codec-Simulation Network for Joint Optimization of Video Coding With Pre- and Post-Processing

Ejemplares similares