边缘和对比度增强的 NSST域红外与可见光图像融合

吴冬鹏; 毕笃彦; 马时平; 何林远; 张跃

红外技术, 2017, 39 (4): 358, 网络出版: 2017-06-02

边缘和对比度增强的 NSST域红外与可见光图像融合

Infrared and Visible Image Fusion Based on Improved Saliency Map in NSST Domain

论文大纲

吴冬鹏 ^1,*毕笃彦 ¹马时平 ¹何林远 ¹张跃 ²

作者单位

¹ 空军工程大学航空航天工程学院，陕西西安 710038

² 中国人民解放军 93787部队，北京 100076

摘要

为了将红外图像的全局信息与可见光图像的细节信息进行有效结合，进一步提高融合后图像的质量，提出了一种同时增强图像边缘细节和对比度的非下采样剪切波变换（ NSST）域红外和可见光图像融合方法。首先，通过平移不变剪切波将图像分解成为低频子带与高频子带，通过全局显著性图分析图像的对比度信息；利用改进型局部显著度图分析图像局部边缘信息。针对不同频带系数，结合边缘信息和对比度信息对频带系数进行融合，最后，利用逆变换得到最终的融合图像。大量实验结果表明，本文方法在提高图像整体对比度的同时增强了图像的边缘细节表现能力，优于现有的基于小波变换，非下采样轮廓波变换（NSCT）和显著度图等几种图像融合方法。

Abstract

For the effective combination of global information of infrared image with detail information of visible image, and further improvement in the quality of the fused image, a fusion method of infrared and visible image based on enhancing contrast and edge of image in non-subsampled Shearlet transform(NSST) domain is proposed. Firstly, the image is decomposed to get the low frequency coefficients and the high frequency coefficients, and the image’s information of contrast is analyzed by global saliency map; the image’s information of edge is analyzed by improved local saliency map. For the different bands, the coefficients are fused using the information of contrast and edge, and the fused image is reconstructed by inverse NSST. A large number of experimental results show that the proposed method enhance the details in the fused image, while preserving the contrast of the image. And it is superior to the existing fused methods such as the method based on wavelet transform, non-subsampled Contourlet transform(NSCT), and the on saliency map and so on.

参考文献

[1] Waxman A, Gove A, Fay D, et al. Color night vision: opponent processing in the fusion of visible and IR imagery[J]. Neural Networks, 1997, 1(10): 1-6.

[2] Pajares G, Manuel J. A wavelet-based image fusion tutorial[J]. Pattern Recognition, 2004, 37: 1855-1872.

[3] Do M N, Vetterli M. The contourlet transform: an efficient directional multi resolution image representation[J]. IEEE Trans on Image Processing, 2005, 12(14): 2091-2106.

[4] 刘坤, 郭雷, 常威威 . 基于 Contourlet变换的区域特征自适应图像融合算法[J].光学学报 , 2008, 28(4): 681-686. LIU Kun, GUO Lei, CHANG Weiwei. Regional feature self-adaptive image fusion algorithm based on contourlet transform[J]. Acia Optica Sinica, 2008, 28(4): 681-686

[5] 张蕾, 金龙旭, 韩双丽 , 等. 采用非采样 Contourlet变换与区域分类的红外和可见光图像融合[J].光学精密工程 , 2015, 23(3): 810-818 ZHANG Lei, JIN Longxu, HAN Shuangli, et al. Fusion of infrared and visual images based on non-sampled contourlet transform and region classification[J]. Optics and Precision Engineering, 2015, 23(3): 810-818.

[6] Guo K H, Labate D, Lim W, et al. Wavelets with composite dilations and their MRA properties[J]. Applied and Computational Harmonic Analysis, 2006, 20: 202-236.

[7] Easley G, Labate D. Sparse directional image representations using the discrete shearlet transform[J]. Applied and Computational Harmonic Analysis, 2008, 25: 25-46.

[8] WANG Lei, LI Bin, TIAN Lianfang. EGGDD: An explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain[J]. Information Fusion, 2014: 29-37.

[9] Lim W. Nonseparable shearlet transform[J]. IEEE Trans on Image Processing, 2013, 22(5): 2056-2065.

[10] Itti L, Koch G, Niebur E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 1998, 20(11): 1254-1259.

[11] MENG F, GUO B, SONG M, et al. Image fusion with saliency map and interest points[J]. Neurocomputing, 2016, 177: 1-8

[12] ZHANG B, LU X, PEI H, et al. A fusion algorithm for infrared and visible images based on saliency analysis and non-subsampled Shearlet transform[J]. Infrared Physics & Technology, 2015, 73: 286-297.

[13] LI J, Levine M D, AN X J, el at. Visual saliency based on scale space analysis in the frequency domain[J]. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2013, 35(4): 996-1010.

[14] LI Z Q, FANG T, HUO H．A saliency model based on wavelet transform and visual attention[J]. Science China Information Sciences, 2010, 53(4): 738-751.

[15] Imamoglu N, LIN W, FANG Y. A saliency detection model using low-level features based on wavelet transform[J]. IEEE Trans. on Multimedia, 2013, 15(1): 96-105.

[16] 彭海, 赵巨峰 , 冯华君 , 等. 基于区域显著性的双波段图像融合方法 [J].浙江大学学报 : 工学版, 2012, 46(11): 2109-2115. PENG Hai, ZHAO Jufeng, FENG Huajun, et al. Dual band image fusion based on region saliency[J]. Journal of Zhejiang University: Engineering Science, 2012, 46(11): 2109-2115.

[17] 张立保, 章钰. 基于显著性分析的自适应遥感图像融合 [J].中国激光, 2015, 42(1): 1-8. ZHANG Libao, ZHANG Yu. A new adaptive fusion method based on saliency analysis for remote sensing images[J]. Chinese Journal of Lasers, 2015, 42(1): 1-8.

[18] 林森, 张俊宇 , 郭金玉 , 等. 局部方向模式在非接触掌纹识别中的应用[J].仪器仪表学报 , 2015, 36(1): 201-208. LIN Sen, ZHANG Junyu, GUO Jinyu, et al. Application of local directional pattern in non-contact palmprint recognition[J]. Chinese Journal of Scientific Instrument, 2015, 36(1): 201-208.

[19] 张小利, 李雄飞, 李军. 融合图像质量评价指标的相关性分析及性能评估[J].自动化学报 , 2014, 40(2): 306-315. ZHANG Xiaoli, LI Xiongfei, LI Jun. Validation and correlation analysis of metrics for evaluating performance of image fusion[J]. Acta Automatic Sinica, 2014, 40(2): 306-315.

吴冬鹏, 毕笃彦, 马时平, 何林远, 张跃. 边缘和对比度增强的 NSST域红外与可见光图像融合[J]. 红外技术, 2017, 39(4): 358. WU Dongpeng, BI Duyan, MA Shiping, HE Linyuan, ZHANG Yue. Infrared and Visible Image Fusion Based on Improved Saliency Map in NSST Domain[J]. Infrared Technology, 2017, 39(4): 358.

边缘和对比度增强的 NSST域红外与可见光图像融合

关于本站 Cookie 的使用提示

全站搜索

边缘和对比度增强的 NSST域红外与可见光图像融合

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索