光电工程, 2019, 46 (11): 180581, 网络出版: 2019-12-08
基于光流传感器的视频稳像技术
Video stabilization technique based on optical flow sensor
电子稳像 运动补偿 光流传感器 旋转运动 electronic image stabilization motion compensation optical flow sensor rotational motion
摘要
针对平台运动导致的视频抖动问题, 提出了一种基于光流传感器的视频稳像技术。该方案首先通过对一般光流传感器的改进, 使其具有旋转运动下输出准确运动矢量的能力, 然后利用光流传感器获得相邻两帧图像之间的运动矢量, 并通过坐标变换计算出主相机的实时平移和旋转信息; 其次, 对原视频图像序列进行运动补偿, 以获得稳定的图像序列, 最终实现了视频稳像。实验结果表明, 稳像后的图像序列与未稳像之前相比峰值信噪比提高了 11.86 dB。该方案在视频抖动较大的情况下, 能够明显减小图像序列的抖动现象, 具有稳像效果好的特点, 满足视频稳像的性能要求, 对提高平台抗扰能力有着较高的实用性。
Abstract
In allusion of the video jitter problem caused by platform motion, a video stabilization technique based on optical flow sensor is presented. Firstly, the scheme improves the general optical flow sensor to output accurate motion vectors under rotational motion, then motion vectors between adjacent frames are obtained by using the optical flow sensor. The real-time translation and rotation information of the main camera are calculated through coordinate transformation. Secondly, the method compensates the motion of video sequences to attain stable video sequences, and finally realizes video stabilization. Experimental results indicate that, compared with the unstable image, the peak signal-to-noise ratio (PSNR) is increased by 11.86 dB. In the case of obvious video jitter, the scheme can significantly reduce the jitter between video sequences. The method which has the characteristics of salutary video stabilization can meet the performance requirements of video stabilization and improve the capacity of disturbance resistance for platform.
周鹏威, 季元吉, 董超, 卢田, 胡世传. 基于光流传感器的视频稳像技术[J]. 光电工程, 2019, 46(11): 180581. Zhou Pengwei, Ji Yuanji, Dong Chao, Lu Tian, Hu Shichuan. Video stabilization technique based on optical flow sensor[J]. Opto-Electronic Engineering, 2019, 46(11): 180581.