光学 精密工程, 2015, 23 (5): 1458, 网络出版: 2015-06-11
基于改进运动矢量估计法的视频稳像
Video stabilization with improved motion vector estimation
电子稳像 视频稳像 特征匹配 粒子滤波 运动补偿 评价指标 electronic image stabilization video stabilization feature matching particle filter motion compensation evaluation index
摘要
提出用改进的运动矢量估计方法对视频序列进行运动补偿, 以有效去除机载成像设备摄取视频序列的帧间抖动, 实现电子稳像。介绍了BRISK算子提取特征的模型和算子描述方式, 利用BRISK算子提取相邻帧的稳定特征点并进行匹配, 结合参数仿射变换模型实现帧间运动矢量粗估计。为了提高运动矢量估计的精度, 引入粒子滤波解决因特征点景深不同引起的运动矢量估计失准的问题, 继而采用加权最小二乘法改进运动矢量估计。最后采用卡尔曼滤波从全局运动矢量里分离出运动补偿分量, 对视频序列进行逐帧补偿。实验表明, 视频序列稳像后的帧间变换保真度值提高了近3 db, 显示提出的的稳像算法可以处理复杂运动下视频的帧间抖动, 且快速准确并具有一定的鲁棒性。
Abstract
An improved motion vector estimation algorithm was proposed to remove effectively the inter frame jitter of the video sequences recorded by airborne imaging equipment and to realize the electronic image stability. The BRISK operator and the corresponding feature extraction model were introduced. Then, the BRISK operator was employed to extract and match the stable feature points of neighbor frames. By combining with the affine transformation motion model, the rough estimation of inter frame motion vectors was implemented. To improve the accuracy of motion vector estimation, the particle filter with the weighted least-square method was employed to solve the problem of the motion vector calculation inaccuracy caused by different depths of the feature points. Finally, the Kalman filter was used to separate the jitter components from the global motion vectors for compensating the video sequences frame by frame. The experimental result indicates that the inter-frame transformation fidelity (ITF) of video sequence has improved about 3 db, which verifies that the proposed stabilized algorithm removes inter-frame jitter of high frequency under complicated movement with fast speed, higher accuracy and stronger robustness.
吉淑娇, 朱明, 雷艳敏, 胡汉平. 基于改进运动矢量估计法的视频稳像[J]. 光学 精密工程, 2015, 23(5): 1458. JI Shu-jiao, ZHU Ming, LEI Yan-min, HU Han-ping. Video stabilization with improved motion vector estimation[J]. Optics and Precision Engineering, 2015, 23(5): 1458.