光学学报, 2017, 37 (1): 0133001, 网络出版: 2017-01-13   

基于视觉显著性的立体显示图像深度调整 下载: 535次

Stereoscopic Display Image Depth Adjustment Based on Visual Saliency
作者单位
苏州科技大学电子与信息工程学院, 江苏 苏州 215009
摘要
基于双目视差的立体显示系统中, 不恰当的图像景深分布是引起视疲劳的主要原因, 因此提出一种新颖的立体深度调整方法以提高立体显示观看视觉舒适度。该方法以原始立体图像作为输入, 应用图像谱残差提取的方法获得立体图像的视觉显著性, 结合特定的观看条件建立视疲劳指标模型, 获取特定图像在特定观看条件下的最佳零视差平面(ZDP)。根据最佳ZDP对原始输入左右视图进行视差调整, 从而获得视疲劳指标最小的立体图像。为了进一步验证该方法对立体显示视觉舒适度的提升效果, 设计并完成了相应的视觉感知实验。实验结果表明, 该方法显著提高了立体显示观看舒适度。
Abstract
In the stereoscopic display system based on binocular parallax, the improper depth distribution is the main cause of eye fatigue, therefore a novel stereoscopic depth adjustment method is proposed to improve the visual comfort. The proposed method takes the original stereoscopic image as the input. The visual saliency map is derived from original stereoscopic image by applying spectral residual extracting method. Combined with the specific viewing condition, a visual fatigue index model is established to calculate the location of optimum zero disparity plane (ZDP) for specific image in specific viewing condition. The original input stereoscopic image is adjusted according to the optimum ZDP to derive the output stereoscopic image with the minimum visual fatigue index. In order to verify the improvement on visual comfort of the proposed depth adjustment method, the visual perception experiment is designed and implemented. Experimental result indicates that the proposed method significantly improves the stereoscopic viewing comfort.
参考文献

[1] 夏振平, 李晓华, 崔 渊, 等. 眼镜式立体显示中的串扰分析及消除方法研究[J]. 光学学报, 2012, 32(10): 1012002.

    Xia Zhenping, Li Xiaohua, Cui Yuan, et al. Crosstalk analysis and cancellation method study in stereoscopic displays[J]. Acta Optica Sinica, 2012, 32(10): 1012002.

[2] 夏振平, 李晓华, 陈 磊, 等. 快门眼镜式立体显示中闪烁的客观评价[J]. 光学学报, 2013, 33(12): 1233001.

    Xia Zhenping, Li Xiaohua, Chen Lei, et al. Objective evaluation of flicker in stereoscopic display with active shutter glasses[J]. Acta Optica Sinica, 2013, 33(12): 1233001.

[3] 夏振平, 李晓华, 陈 磊, 等. 对快门式立体显示中环境光闪烁的影响研究[J]. 光学学报, 2014, 34(7): 0733002.

    Xia Zhenping, Li Xiaohua, Chen Lei, et al. Study on the effect of ambient light flicker in stereoscopic display with active shutter glasses[J]. Acta Optica Sinica, 2014, 34(7): 0733002.

[4] 夏振平, 李晓华, 陈 磊, 等. 基于双目视差的立体显示运动模糊评价方法研究[J]. 光学学报, 2015, 35(1): 0111001.

    Xia Zhenping, Li Xiaohua, Chen Lei, et al. Study on evaluation of motion blur in binocular parallax based stereoscopic displays[J]. Acta Optica Sinica, 2015, 35(1): 0111001.

[5] Hoffman D M, Girshick A R, Akeley K, et al. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue[J]. Journal of Version, 2008, 8(3): 33.1-30.

[6] Jung Y, Sohn H, Lee S, et al. Predicting visual discomfort of stereoscopic images using human attention model[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2013, 23(12): 2077-2082.

[7] Kishi S, Abe N, Shibata T, et al. Stereoscopic camera system with creator-friendly functions[C]. SPIE Electronic Imaging, International Society for Optics and Photonics, 2009, 7237: 72371M.

[8] Urey H, Chellappan K V, Erden E, et al. State of the art in stereoscopic and autostereoscopic displays[C]. Proceedings of the IEEE, 2011, 99(4): 540-555.

[9] Jiang Q, Shao F, Jiang G, et al. A depth perception and visual comfort guided computational model for stereoscopic 3D visual saliency[J]. Signal Processing: Image Communication, 2015, 38: 57-69.

[10] Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(11): 1254-1259.

[11] Hou X, Zhang L. Saliency detection: A spectral residual approach[C]. IEEE Conference on Computer Vision and Pattern Recognition, 2007: 1-8.

[12] Bruce N D, Tsotsos J K. Saliency, attention, and visual search: An information theoretic approach[J]. Journal of Version, 2009, 9(3): 5.1-24.

[13] Cheng M, Zhang G, Mitra N J, et al. Global contrast based salient region detection[C]. IEEE Conference on Computer Vision and Pattern Recognition, 2011, 37(3): 409-416.

[14] Yarbus A L. Eye movements and vision[M]. New York: Plenum Press, 1967.

[15] 王士一, 王 双, 张立保. 一种结合显著性分析的高分辨率遥感图像道路提取算法[J]. 光学学报, 2015, 35(s2): s210001.

    Wang Shiyi, Wang Shuang, Zhang Libao. A road extraction algorithm with saliency analysis in high-resolution remote sensing images[J]. Acta Optica Sinica, 2015, 35(s2): s210001.

[16] 莫邵文, 邓新蒲, 王 帅, 等. 基于改进视觉背景提取的运动目标检测算法[J]. 光学学报, 2016, 36(6): 0615001.

    Mo Shaowen, Deng Xinpu, Wang Shuai, et al. Moving object detection algorithm based on improved visual background extractor[J]. Acta Optica Sinica, 2016, 36(6): 0615001.

[17] Wang J, Da Silva M P, Le Callet P, et al. Computational model of stereoscopic 3D visual saliency[J]. IEEE Transactions on Image Processing, 2013, 22(6): 2151-2165.

[18] Klaus A, Sormann M, Karner K. Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure[C]. 18th International Conference on Pattern Recognition, 2006, 3: 15-18.

[19] BT Series. Subjective methods for the assessment of stereoscopic 3D TV systems: ITU-R BT.2021-1[S]. Geneva: International Telecommunication Union, 2015.

[20] BT Series. Methodology for the subjective assessment of the quality of television picture: ITU-R BT.500[S]. Geneva: International Telecommunication Union, 2012.

[21] Kishi S, Yamazoe T, Shibata T, et al. An ergonomic evaluation system for stereoscopic 3D images[J]. Journal of the Institute of Image Information and Television Engineers, 2006, 60(6): 934-942.

[22] Atallah P, Pelah A, Wilkins A J. Visual stress symptoms from stereoscopic television[C]. International Conference on 3D Imaging, 2012: 1-7.

[23] 谭泽富, 丁妍芝, 雷国平, 等. 基于视觉显著性图的立体图像视疲劳评价[J]. 电视技术, 2015, 39(7): 108-110.

    Tan Zefu, Ding Yanzhi, Lei Guoping, et al. Attention model-based visual discomfort evaluation model of stereoscopic display[J]. Video Engineering, 2015, 39(7): 108-110.

夏振平, 程成. 基于视觉显著性的立体显示图像深度调整[J]. 光学学报, 2017, 37(1): 0133001. Xia Zhenping, Cheng Cheng. Stereoscopic Display Image Depth Adjustment Based on Visual Saliency[J]. Acta Optica Sinica, 2017, 37(1): 0133001.

本文已被 9 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!