首页 > 论文 > 激光与光电子学进展 > 55卷 > 6期(pp:61013--1)

基于感兴趣区域的360°全景视频编码

360° Panoramic Video Coding Based on Region of Interest

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

针对360°全景视频在等矩形投影面中编码时存在冗余像素较多且较少考虑感兴趣区域(ROI)画面质量的问题, 提出一种基于ROI的360°全景视频编码算法。该算法利用当前帧编码残差信息求取ROI并指导下一帧编码;利用球面到等矩形投影面的映射函数求出各纬度处像素的冗余程度, 将其作为非ROI量化参数的调节因子, 并与ROI量化参数调节因子共同决定每帧画面最大编码单元级别的编码参数设置。实验结果表明, 在使用加权球面峰值信噪比和球面峰值信噪比全景视频客观评价方法评价编码效果时, 与HEVC编码器参考软件相比, 本文方法码率最高可节省4.98%, 平均码率可节省2.46%, 相同码率下视频质量平均提高0.145 dB。与相关代表性方法相比, ROI内容质量明显提升。

Abstract

In order to solve the problem that more redundant pixels and less consideration of picture quality of the region of interest (ROI) when the 360° panoramic video is encoded in an equirectangualr projection plane. A new ROI-based 360° panoramic video coding method is proposed, which uses the current coding residual frame information to get and guide the next frame coding. The pixel redundancy at each latitude is calculated by the mapping function from the sphere to the projection plane, which is used as the adjustment factor of quantization parameters of non-ROI. The quantization parameters of ROI and non-ROI are utilized to determine each frame′s encoding parameters in largest coding unit level. The experimental results show that, compared with the HEVC encoder, for the same weighted spherical peak signal-to-noise ratio and spherical peak signal-to-noise ratio, the proposed approach can achieve an average rate reduction of about 2.46% and the most of 4.98%, for the same coding rate, it can achieve an average video quality increased 0.145 dB. The content of ROI improves obviously compared with the related representative methods.

Newport宣传-MKS新实验室计划
补充资料

中图分类号:TN919.8

DOI:10.3788/lop55.061013

所属栏目:图像处理

基金项目:国家自然科学基金(61671258, 61771269, 61620106012)、浙江省自然科学基金(LY16F010002, LY15F010005, LY17F010005)

收稿日期:2017-11-23

修改稿日期:2017-12-25

网络出版日期:--

作者单位    点击查看

吴志强:宁波大学信息科学与工程学院, 浙江 宁波 315211
郁梅:宁波大学信息科学与工程学院, 浙江 宁波 315211南京大学计算机软件新技术国家重点实验室, 江苏 南京 210093
姜浩:宁波大学信息科学与工程学院, 浙江 宁波 315211
陈芬:宁波大学信息科学与工程学院, 浙江 宁波 315211
蒋刚毅:宁波大学信息科学与工程学院, 浙江 宁波 315211南京大学计算机软件新技术国家重点实验室, 江苏 南京 210093

联系人作者:郁梅(yumei2@126.com)

备注:吴志强(1991-), 男, 硕士研究生, 主要从事视频编码方面的研究。E-mail: wuzhiqiang1205@126.com

【1】Jrvinen A. Virtual reality as trend contextualising an emerging consumer technology into trend analysis[C]. IEEE Future Technologies Conference, 2016: 1065-1070.

【2】Chen J H, Guo W S. Method of panoramic image stitching for theodolite-camera system[J]. Laser & Optoelectronics Progress, 2016, 53(5): 051001.
陈继华, 郭文松. 基于摄影经纬仪的全景图像拼接方法[J]. 激光与光电子学进展, 2016, 53(5): 051001.

【3】Jiang X L, Wang S C, Luo S W, et al. Real-time panoramic imaging method for train-borne forward motion video[J]. Acta Optica Sinica, 2017, 37(5): 0515003.
蒋欣兰, 王胜春, 罗四维, 等. 车载前向运动视频的实时全景成像方法[J]. 光学学报, 2017, 37(5): 0515003.

【4】Zhang C P, Wang Q. Survey on imaging model and calibration of light field camera[J]. Chinese Journal of Lasers, 2016, 43(6): 0609004.
张春萍, 王庆. 光场相机成像模型及参数标定方法综述[J]. 中国激光, 2016, 43(6): 0609004.

【5】Xiao C, Chen F, Zhou M, et al. Panoramic display system geometric calibration method based on fisheye camera[J]. Laser & Optoelectronics Progress, 2017, 54(2): 021501.
肖朝, 陈锋, 钟敏, 等. 基于鱼眼相机的全景显示系统几何校正方法[J]. 激光与光电子学进展, 2017, 54(2): 021501.

【6】See Z S, Billinghurst M, Cheok A D. Augmented reality using high fidelity spherical panorama with HDRI[C]∥SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, 2015: 14.

【7】Nakazawa M, Koike H.Synthesizing fixed point of views from a spinning omnidirectional ball camera[C]∥Proceedings of the 8th Augmented Human International Conference, 2017: 32.

【8】Ye Y, Alshina Elena, Boyce Jill. Algorithm descriptions of projection format conversion and video quality metrics in 360Lib[C]. Joint Video Exploration Team of ITU-T SG, 2017, 16.

【9】Zare A, Aminlou A, Hannuksela M M, et al. HEVC-compliant tile-based streaming of panoramic video for virtual reality applications[C]∥Proceedings of the 2016 ACM on Multimedia Conference, 2016: 601-605.

【10】Zare A, Sreedhar K K, Vadakital V K M, et al. HEVC-compliant viewport-adaptive streaming of stereoscopic panoramic video[C]. IEEE Picture Coding Symposium (PCS), 2016: 1-5.

【11】Budagavi M, Furton J, Jin G, et al. 360 degrees video coding using region adaptive smoothing[C]. IEEE International Conference on Image Processing, 2015: 750-754.

【12】Li J, Wen Z, Li S, et al. Novel tile segmentation scheme for omnidirectional video[C]. 2016 IEEE International Conference on Image Processing, 2016: 370-374.

【13】Lee S H, Kim S T, Yip E, et al. Omnidirectional video coding using latitude adaptive down-sampling and pixel rearrangement[J]. Electronics Letters, 2017, 53(10): 655-657.

【14】Zakharchenko V, Choi K P, Park J H. Quality metric for spherical panoramic video[C]. SPIE, 2016, 9970: 99700C.

【15】Yu M, Lakshman H, Girod B. A framework to evaluate omnidirectional video coding schemes[C]. 2015 IEEE International Symposium on Mixed and Augmented Reality, 2015: 31-36.

【16】Xue X B, Yu M, He M L. Stereoscopic image-quality-assessment method based on visual cell model[J]. Laser & Optoelectronics Progress, 2016, 53(4): 041004.
薛小波, 郁梅, 何美伶. 基于仿视觉细胞模型的立体图像质量评价方法[J]. 激光与光电子学进展, 2016, 53(4): 041004.

【17】Jiang G Y, Zhu Y P,Yu M, et al. Perceptual video coding: a survey[J]. Journal of Electronics & Information Technology, 2013, 35(2): 474-483.
蒋刚毅, 朱亚培, 郁梅, 等. 基于感知的视频编码方法综述[J]. 电子与信息学报, 2013, 35(2): 474-483.

【18】Abbas A. GoPro test sequences for virtual reality video coding[C]. Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG, Geneva, 2016.

【19】Simone F D, Frossard P, Wilkins P, et al. Geometry-driven quantization for omnidirectional image coding[C]. IEEE Picture Coding Symposium (PCS), 2016: 1-5.

【20】Racapé F, Galpin F, Rath G, et al. AHG8: adaptive QP for 360 video coding[C]. Joint Video Exploration Team (JVET) JVET-F0038, m40327, 2017.

引用该论文

Wu Zhiqiang,Yu Mei,Jiang Hao,Chen Fen,Jiang Gangyi. 360° Panoramic Video Coding Based on Region of Interest[J]. Laser & Optoelectronics Progress, 2018, 55(6): 061013

吴志强,郁梅,姜浩,陈芬,蒋刚毅. 基于感兴趣区域的360°全景视频编码[J]. 激光与光电子学进展, 2018, 55(6): 061013

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF