移动车载视频的立体全景图生成方法

装载有视频采集设备的巡检列车已被应用于铁路环境监测中。提出了一种从前向运动的列车车载视频中生成铁路环境立体全景图的方法，该方法仅使用一个摄像设备即可获取整个场景的立体全景信息。基于场景的几何先验和标定的相机参数从视频序列中连续地抽取一组梯形窄带作为完全采样拼接区域，窄带的宽度根据车速自动调节，将所有窄带经单应性变换修正后拼接得到全景图像，并据此构建准确的几何模型来生成全景立体像对。实验结果表明，该方法能够快速有效地生成具有立体感的全景图。与原始的视频格式相比，生成的全景图所需存储空间小，具有更广阔的视野和更强的真实感，可实现铁路场景的快速访问和沉浸式浏览。

Abstract

The patrol train with picture pick-up device has been used for railway environment monitoring. A method to generate the stereo panorama from forward motion train-borne video using only one camera to acquire the panoramic stereo information of the entire scene is presented. On the basis of the geometric priori information of the scene and known camera parameters, a set of trapezoidal stripes is extracted from a video sequence continuously, whose width is automatically adjusted according to the vehicle speed, and the stripes are stitched into a panoramic image after aligning all the stripes by homography transformation. The accurate geometric model is built to generate the panoramic stereo pairs. The experimental results show that the method can effectively and efficiently generate a stereoscopic panorama. Compared with the original video format, the stereo panorama requires less storage space, possesses wider field of view and greater realism, and enables the inspector to perform quick examination and immersive browsing.

参考文献

[1] 侯卫星. 0号高速综合检测列车[M]. 北京: 中国铁道出版社, 2010.

[2] 中国铁道科学研究院. 高速综合检测列车技术交流总结[R]. 2006.

[3] B Micusik, J Kosecka. Piecewise planar city 3D modeling from street view panoramic sequences [C]. IEEE Conference on CVPR, 2009. 2906-2912.

[4] 廖超, 王贵锦, 沈永玲, 等. 航拍视频的多向条带拼接算法[J]. 宇航学报, 2012, 33(11): 2065-2073.

Liao Chao, Wang Guijin, Shen Yongling, et al.. Aerial video stitchign via multi-direction strips [J]. Journal of Astronautics, 2012, 33(11): 2065-2073.

[5] Z Zhu, A R Hanson, H Schultz, et al.. Stereo mosaics from a moving video camera for environmental monitoring [C]. International Workshop on Digital and Computational Video, 1999. 45-54.

[6] S E Chen. Quick time VR: An image-based approach to virtual environment navigation [C]. 22nd annual conference on Computer Graphics and Interactive techniques, 1995. 29-38.

[7] 吴宪祥, 郭宝龙, 王娟. 基于相位相关的柱面全景图像自动拼接算法[J]. 光学学报, 2009, 29(7): 1824-1829.

Wu Xianxiang, Guo Baolong, Wang Juan. Cylindrical panoramic image automatic mosaic algorithm based on phase correlation [J]. Acta Optica Sinica, 2009, 29(7): 1824-1829.

[8] 王会峰, 刘上乾, 汪大宝, 等. 旋转扫描序列图像的全景图拼接方法[J]. 光学学报, 2009, 29(5): 1211-1215.

Wang Huifeng, Liu Shangqian, Wang Dabao, et al.. Panoramic image mosaic method for rotary scanning serial image [J]. Acta Optica Sinica, 2009, 29(5): 1211-1215.

[9] S Peleg, J Herman. Panorama mosaics by manifold projection [C]. IEEE Conference on CVPR, 1997. 338-343.

[10] S Peleg, B Rousso, A Rav-Acha, et al.. Mosaicing on adaptive manifolds [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(10): 1144-1154.

[11] 蒋纯, 石教英, 潘志庚. 基于多深度狭缝图像全景拼图的场景绘制[J]. 浙江大学学报(工学版), 2002, 36(2): 162-165.

Jiang Chun, Shi Jiaoying, Pan Zhigeng. Rendering using multiple panoramic mosaics of slit images with depth [J]. Jounal of Zhejiang University (Engineering Scinece), 2002, 36(2): 162-165.

[12] J Y Zheng. Digital route panoramas [J]. IEEE MultiMedia, 2003, 10(3): 57-67.

[13] H C Huang, Y P Hung. Panoramic stereo imaging system with automatic disparity warping and seaming [J]. Graphical Models and Image Processing, 1998, 60(3): 196-208.

[14] S Peleg, B E Moshe. Stereo panorama with a single camera [C]. IEEE Conference on CVPR, 1999. 1-8.

[15] Z Zhu, A R Hanson, E M Riseman. Generalized parallel-perspective stereo mosaics from airborne video [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(2): 226-237.

[16] 田延冰, 白剑, 黄治. 基于全景环带立体成像系统的深度信息估计[J]. 光学学报, 2013, 33(6): 0611002.

Tian Yanbing, Bai Jian, Huang Zhi. Depth estimation with a panoramic stereo imaging system [J]. Acta Optica Sinica, 2013, 33(6): 0611002.

[17] 张春雨, 王文, 邱亚特, 等. 视频拼接中最优自适应单应性矩阵求解算法[J]. 吉林大学学报（工学版）, 2013, 43(4): 1116-1120.

Zhang Chunyu, Wang Wen, Qiu Yate, et al.. Algorithm for optimal homography matrix in video mosaic [J]. Journal of Jilin University (Engineering and Technology Edition), 2013, 43(4): 1116-1120.

[18] J Y Zheng, M Shi. Scanning depth of route panorama based on stationary blur [J]. International Journal on Computer Vision, 2008, 78(2-3): 169-186.

[19] P Moghadam, J A Starzyk, W S Wijesoma. Fast vanishing-point detection in unstructured environments [J]. IEEE Transaction on Image Processing, 2012, 21(1): 425-430.

王胜春, 罗四维, 黄雅平, 王亮, 戴鹏. 移动车载视频的立体全景图生成方法[J]. 光学学报, 2014, 34(12): 1215005. Wang Shengchun, Luo Siwei, Huang Yaping, Wang Liang, Dai Peng. Stereo Panorama Generation from the Train-Borne Video[J]. Acta Optica Sinica, 2014, 34(12): 1215005.

移动车载视频的立体全景图生成方法

关于本站 Cookie 的使用提示

全站搜索

移动车载视频的立体全景图生成方法

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索