首页 > 论文 > 液晶与显示 > 33卷 > 9期(pp:808-815)

基于OpenGL的交互式全景视频显示系统

Interactive omnidirectional video display system based on OpenGL

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

随着虚拟现实和多媒体通信技术的快速发展,全景视频作为一种新兴的数字媒体,凭借其良好的临场感和沉浸感在影视娱乐、教育教学、工业仿真、医学研究等众多领域取得广泛应用。为了更好地开展全景视频的相关研究,建立交互式的全景视频显示系统成为了优化和完善全景视频业务的重要前提。本文基于OpenGL渲染技术,结合用户对于全景视频交互操作的需求,搭建了交互式全景视频显示系统,并在该系统上通过实验分析了本系统的交互时延和视频分辨率、帧率的关系。实验结果表明,交互产生的时延和视频分辨率、帧率的大小呈正相关关系。在本平台的设置下,交互产生的时延不超过0.02 s,为用户提供了良好的交互性和视觉体验,为全景视频的相关研究与应用开发提供了稳定的平台。

Abstract

With the rapid development of virtual reality and multimedia communication technology, omnidirectional video has become a major form of immersive media. Due to the sense of presence and immersion provided to the end users, omnidirectional videos have been widely applied in many fields including entertainment, education, industrial simulation, and medicine. To facilitate the research on omnidirectional videos, establishing an interactive omnidirectional video display system is an important precondition. Based on the OpenGL rendering technology, this paper built an interactive omnidirectional video display system according to the display demand of end users. To analyze the performance of the proposed system, the relationship between the interaction delay and the video resolution as well as the frame rate were investigated. Experimental results showed that the interaction delay is proportional to the video resolution and the frame rate and the maximum delay of the proposed system is only 0.02 s in the test condition which is able to provide end users with satisfying interactivity and visual experience. The proposed system can serve as a stable platform for conducting research on omnidirectional videos.

Newport宣传-MKS新实验室计划
补充资料

中图分类号:TN141

所属栏目:图像处理

基金项目:中央高校基本科研业务费(No.JB180105);国家自然科学基金(No. 61601349, No. 61571337)

收稿日期:2018-05-05

修改稿日期:2018-06-20

网络出版日期:--

作者单位    点击查看

周凡:西安电子科技大学 综合业务网理论及关键技术国家重点实验室,陕西 西安 710071
张伟:西安电子科技大学 综合业务网理论及关键技术国家重点实验室,陕西 西安 710071
杨付正:西安电子科技大学 综合业务网理论及关键技术国家重点实验室,陕西 西安 710071

联系人作者:周凡(fzhou_945@stu.xidian.edu.cn)

备注:周凡(1994-),男,江苏南通人,硕士研究生,研究方向为计算机图形学与虚拟现实。E-mail: fzhou_945@stu.xidian.edu.cn

【1】QIAN F, JI L S, HAN B, et al. Optimizing 360 video delivery over cellular networks [C]//Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. New York: ACM, 2016: 1-6..

【2】GHIMIRES. Production of 360° video: Introduction to 360° video and production guidelines [D].Helsinki: Helsinki Metropolia University of Applied Sciences, 2016:8-12.

【3】SZELISKI R, SHUM H Y. Creating full view panoramic image mosaics and environment maps [C]//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM Press/Addison-Wesley Publishing Co., 1997: 251-258.

【4】NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005, 15(1): 82-95.

【5】HUANG K C, CHIEN P Y, CHIEN C A, et al. A 360-degree panoramic video system design [C]//Technical Papers of 2014 International Symposium on VLSI Design, Automation and Test. Hsinchu, Taiwan, China: IEEE, 2014: 1-4.

【6】FU C W, WAN L, WONG T T, et al. The rhombic dodecahedron map: An efficient scheme for encoding panoramic video [J]. IEEE Transactions on Multimedia, 2009, 11(4): 634-644.

【7】LIU Y F, YANG L, XU M, et al. Rate control schemes for panoramic video coding [J]. Journal of Visual Communication and Image Representation, 2018, 53: 76-85.

【8】ZONG T Y, TU Z Z, AI L, et al. Panoramic video delivery based on Laplace compensation and Sphere-Markov probability model [C]//Proceedings of 2018 IEEE International Conference on Consumer Electronics (ICCE). Las Vegas, NV, USA: IEEE, 2018: 1-4.

【9】孔令胜,南敬实,荀显超. 平面三维显示技术的研究现状[J]. 中国光学与应用光学,2009,2(2):112-118.
KONG L S, NAN J S, XUN X C. Research status quo of flat 3-D display technology [J]. Chinese Journal of Optics and Applied Optics, 2009, 2(2): 112-118. (in Chinese)

【10】赵星,王芳,杨勇,等. 集成成像三维显示系统显示性能的研究进展[J]. 中国光学,2012,5(3):209-221.
ZHAO X, WANG F, YANG Y, et al. Research progress of display performance of integral imaging three-dimensional display system [J]. Chinese Optics, 2012, 5(3): 209-221. (in Chinese)

【11】CHENG Y. Progress in display technologies and their applications [J]. Chinese Journal of Optics and Applied Optics, 2010, 3(1): 27-32.

【12】ZORIC G, BARKHUUS L, ENGSTRM A, et al. Panoramic video: design challenges and implications for content interaction [C]//Proceedings of the 11th European Conference on Interactive TV and Video. Como, Italy: ACM, 2013: 153-162.

【13】NENG L A R, CHAMBEL T. Get around 360° hypervideo [C]//Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments. Tampere, Finland: ACM, 2010: 119-122.

【14】施珂奕,邓春健,邹昆. 基于OpenGL的三维模型点坐标拾取方法[J]. 液晶与显示,2016,31(7):708-713.
SHI K Y, DENG C J, ZOU K. Point pick-up in three-dimension model based on OpenGL [J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(7): 708-713. (in Chinese)

【15】RAKKOLAINEN I, RAISAMO R, TURK M, et al. Casual immersive viewing with smartphones [C]//Proceedings of the 20th International Academic Mindtrek Conference. Tampere, Finland: ACM, 2016: 449-452

【16】HEARN D D, BAKER M P, CARITHERS W R. Computer graphics with OpenGL [M]. 4th ed. Upper Saddle River: Prentice Hall Press, 2010.

【17】SHREINER D, SELLERS G, KESSENICH J, et al. OpenGL Programming Guide: The Official Guide to Learning OpenGL [M]. version 4.3 8th ed. Reading: Addison-Wesley, 2013.

【18】HOWARD I P, ROGERS B J. Binocular Vision and Stereopsis [M]. New York, USA: Oxford University Press, 1995.

引用该论文

ZHOU Fan,ZHANG Wei,YANG Fu-zheng. Interactive omnidirectional video display system based on OpenGL[J]. Chinese Journal of Liquid Crystals and Displays, 2018, 33(9): 808-815

周凡,张伟,杨付正. 基于OpenGL的交互式全景视频显示系统[J]. 液晶与显示, 2018, 33(9): 808-815

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF