Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video

Abstract The MPEG immersive video (MIV) has been designed to remove the redundancies of multi‐view videos and merge the residuals into two textures and two geometry videos; therefore, four bitstreams and video decoders are required to provide six degrees of freedom (6DoF) in virtual reality (VR) in...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Jong‐Beom Jeong, Soonbin Lee, Eun‐Seok Ryu
Formato: article
Lenguaje:EN
Publicado: Wiley 2021
Materias:
Acceso en línea:https://doaj.org/article/93feaec73d30490db235639f19a2094e
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:93feaec73d30490db235639f19a2094e
record_format dspace
spelling oai:doaj.org-article:93feaec73d30490db235639f19a2094e2021-12-03T08:34:31ZSub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video1350-911X0013-519410.1049/ell2.12329https://doaj.org/article/93feaec73d30490db235639f19a2094e2021-12-01T00:00:00Zhttps://doi.org/10.1049/ell2.12329https://doaj.org/toc/0013-5194https://doaj.org/toc/1350-911XAbstract The MPEG immersive video (MIV) has been designed to remove the redundancies of multi‐view videos and merge the residuals into two textures and two geometry videos; therefore, four bitstreams and video decoders are required to provide six degrees of freedom (6DoF) in virtual reality (VR) in MIV. This letter proposes a sub‐bitstream packing method and realisation in tiled streaming for MIV to provide a single bitstream for legacy systems that have a single decoder without an increase in the server‐side storage. The proposed method divided the input videos into tiles in the compressed‐domain to accomplish two goals: (i) generate a merged bitstream using the existing four bitstreams for legacy systems and (ii) improve the quality of an immersive video by disabling the deblocking filter. For a player with one or few numbers of decoders, the extracted tile sub‐streams were merged by the proposed four specific mixed‐quality tiling and packing methods using a motion‐constrained tile set (MCTS), while complying with the high‐efficiency video coding (HEVC) standard. Experimental results demonstrated that the proposed sub‐stream packing method required a single decoder and exhibited 17.40% decoding time and 0.81% bjontegaard‐delta rate (BD‐rate) savings on Y‐PSNR saving compared to the non‐tiled streaming method.Jong‐Beom JeongSoonbin LeeEun‐Seok RyuWileyarticleElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENElectronics Letters, Vol 57, Iss 25, Pp 973-976 (2021)
institution DOAJ
collection DOAJ
language EN
topic Electrical engineering. Electronics. Nuclear engineering
TK1-9971
spellingShingle Electrical engineering. Electronics. Nuclear engineering
TK1-9971
Jong‐Beom Jeong
Soonbin Lee
Eun‐Seok Ryu
Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
description Abstract The MPEG immersive video (MIV) has been designed to remove the redundancies of multi‐view videos and merge the residuals into two textures and two geometry videos; therefore, four bitstreams and video decoders are required to provide six degrees of freedom (6DoF) in virtual reality (VR) in MIV. This letter proposes a sub‐bitstream packing method and realisation in tiled streaming for MIV to provide a single bitstream for legacy systems that have a single decoder without an increase in the server‐side storage. The proposed method divided the input videos into tiles in the compressed‐domain to accomplish two goals: (i) generate a merged bitstream using the existing four bitstreams for legacy systems and (ii) improve the quality of an immersive video by disabling the deblocking filter. For a player with one or few numbers of decoders, the extracted tile sub‐streams were merged by the proposed four specific mixed‐quality tiling and packing methods using a motion‐constrained tile set (MCTS), while complying with the high‐efficiency video coding (HEVC) standard. Experimental results demonstrated that the proposed sub‐stream packing method required a single decoder and exhibited 17.40% decoding time and 0.81% bjontegaard‐delta rate (BD‐rate) savings on Y‐PSNR saving compared to the non‐tiled streaming method.
format article
author Jong‐Beom Jeong
Soonbin Lee
Eun‐Seok Ryu
author_facet Jong‐Beom Jeong
Soonbin Lee
Eun‐Seok Ryu
author_sort Jong‐Beom Jeong
title Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
title_short Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
title_full Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
title_fullStr Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
title_full_unstemmed Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
title_sort sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video
publisher Wiley
publishDate 2021
url https://doaj.org/article/93feaec73d30490db235639f19a2094e
work_keys_str_mv AT jongbeomjeong subbitstreampackingbasedlightweighttiledstreamingfor6degreeoffreedomimmersivevideo
AT soonbinlee subbitstreampackingbasedlightweighttiledstreamingfor6degreeoffreedomimmersivevideo
AT eunseokryu subbitstreampackingbasedlightweighttiledstreamingfor6degreeoffreedomimmersivevideo
_version_ 1718373404410642432