红外技术, 2013, 35 (12): 773, 网络出版: 2014-01-08
面向鲁棒视觉监控的热红外与可见光视频融合运动目标检测
Moving Target Detection Using Fusion of Visual and Thermal Video for Robust Surveillance
运动目标检测 视频监控 热红外视频 可见光视频 数据融合 moving target detection video surveillance thermal video visible video data fusion
摘要
在非受控环境中,由于背景的动态变化或光照、阴影的影响,执行高效、实时的运动目标检测具有很大的挑战性,联合长波红外(LWIR 8~14 μm)和可见光相机构成一个多模视觉系统可以显著提高运动目标检测的鲁棒性和完整性。提出了一种先检测后融合的运动目标检测算法,首先对可见光视频采用混合高斯建模方法检测运动目标,对热红外视频设计了基于背景差分和时间差分相结合的加权算法提取运动区域,然后对可见光与热红外视频中运动目标进行特征级融合。实验结果表明:该方法利用热红外与可见光图像的直观互补特征,在满足实时性要求的同时,可实现运动目标的精确、完整、鲁棒性检测。
Abstract
In uncontrolled environments, because of the effect of dynamic background, lighting changes and shadows, it is challenging to perform an efficient and real-time moving target detection algorithm. Constructing a multi-mode visual surveillance system with long wave infrared(LWIR 8-14 μm) and visible cameras can significantly improve the robustness and completeness of moving objects extraction. This paper presents a detection-fusion moving target detection algorithm. It starts from a Gaussian mixture background modeling algorithm for moving objects extraction in visible video and a weighted method based on background subtraction and the time-stepping for moving target detection in thermal video. The moving targets, obtained from visible and thermal video, are then fused at the feature level. The experimental results demonstrate that this method which uses the intuitive and complementary information from thermal and visual imagery can meet the real-time requirements, and can also get more complete, accurate and robust detection.
张笙, 李郁峰, 严云洋, 徐铭蔚, 熊平, 唐遵烈. 面向鲁棒视觉监控的热红外与可见光视频融合运动目标检测[J]. 红外技术, 2013, 35(12): 773. ZHANG Sheng, LI Yu-feng, YAN Yun-yang, XU Ming-wei, XIONG Ping, TANG Zun-lie. Moving Target Detection Using Fusion of Visual and Thermal Video for Robust Surveillance[J]. Infrared Technology, 2013, 35(12): 773.