深层跳线残差网络热红外图像超分辨重建

邓伟; 陈建飞; 张胜

doi:doi:10.3969/j.issn.1671-637x.2023.03.005

电光与控制, 2023, 30 (3): 27, 网络出版: 2023-04-03

深层跳线残差网络热红外图像超分辨重建

Super-Resolution Reconstruction of Thermal Infrared Image in Deep Residual Network With Skip Connections

论文大纲

邓伟陈建飞张胜

作者单位

南京邮电大学电子与光学工程学院、柔性电子(未来技术)学院,南京 210000

摘要

在公共安全、**等领域高分辨率热红外图像能够提供更多的场景细节信息, 有着广泛的应用需求,但高昂的设备成本限制了高分辨率红外图像的获取。为此设计了一种多级跳线深层残差卷积神经网络(DR-CNN), 通过软件超分辨的方法重构出高分辨率的红外图像。采用多级跳线双通道注意力残差块增加卷积深度以解决卷积层间缺乏关联性的问题; 使用Concat模块实现局部特征信息的融合, 利用反卷积层进行特征图像的上采样, 使其直接从低分辨率图像学习到高分辨率图像以降低训练的复杂度, 加快运行速度。所提算法与SRCNN, FSRCNN和ADSR等算法进行对比测试, 使用峰值信噪比(PSNR)和结构相似度(SSIM)作为算法的评价指标。实验结果表明提出的RD-CNN算法优于其他对比算法, 生成的高分辨率图像细节丰富且清晰。

Abstract

In public security and other fields, high-resolution thermal infrared image can provide more scene details, and has a wide range of application requirements.However, high equipment cost limits the acquisition of high-resolution infrared images.In this paper, a multistage skip Deep Residual Convolutional Neural Network (DR-CNN) is designed to reconstruct high resolution infrared images by software super-resolution method.Multistage skip dual-channel attention residual blocks are used to increase the convolution depth to solve the problem of lack of correlation between convolution layers.In order to reduce the complexity of training and speed up the operation, Concat module is used to realize the local feature information fusion and the deconvolution layer is used to upsample the feature images directly from low resolution images to high resolution images.Compared with SRCNN, FSRCNN and ADSR, the Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity (SSIM) are used as evaluation indexes.Experimental results show that the DR-CNN algorithm proposed is superior to other algorithms, and the generated high-resolution images are rich in detail and clear.

参考文献

[1] 马悦.基于条件生成对抗网络的医学手术图像去烟算法［J］.计算机与现代化,2021(1):50-55.

[2] MARCUS M.Super-resolution of PROBA-V images using convolutional neural networks［J］.Astrodynamics, 2019, 3(4):387-402.

[3] LUO Z Y, YU J P, LIU Z H.The super-resolution reconstruction of SAR image based on the improved FSRCNN［J］.The Journal of Engineering, 2019, 2019(19):5975-5978.

[4] 苏衡,周杰,张志浩.超分辨率图像重建方法综述［J］.自动化学报,2013,39(8):1202-1213.

[5] KEYS R G.Cubic convolution interpolation for digital image processing［J］.IEEE Transactions on Acoustics Speech and Signal Processing, 1982, 29(6):1153-1160.

[6] 袁琪,荆树旭.改进的序列图像超分辨率重建方法［J］.计算机应用,2009,29(12):3310-3313.

[7] DONG C.Image super-resolution using deep convolutional networks［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2):295-307.

[8] KIM J W, LEE J K, LEE K M.Accurate image super-resolution using very deep convolutional networks［C］//IEEE Conference on Computer Vision & Pattern Recognition(CVPR).Las Vegas:IEEE, 2016: 1646-1654.

[9] DONG C, LOY C C, TANG X O.Accelerating the super-resolution convolutional neural network［C］//European Conference on Computer Vision.Cham:Springer, 2016:391-407.

[10] 赵小强,宋昭漾.多级跳线连接的深度残差网络超分辨率重建［J］.电子与信息学报,2019,41(10):2501-2508.

[11] HE K M, ZHANG X Y, REN S Q, et al.Deep residual learning for image recognition［C］//IEEE Conference on Computer Vision & Pattern Recognition (CVPR).Las Vegas:IEEE, 2016:770-778.

[12] 曲海成,唐博文,袁贵森.改进的超分辨率图像重建算法［J］.激光与光电子学进展,2021,58(2):191-200.

[13] CHEN L, ZHANG H W, XIAO J, et al.SCA-CNN: spatial and channel-wise attention in convolutional networks for image captioning［C］//IEEE Conference on Computer Vision & Pattern Recognition(CVPR).Honolulu:IEEE, 2017:6298-6306.

[14] ZHAO W D, LI S S, LI A, et al.Hyperspectral images classification with convolutional neural network and textural feature using limited training samples［J］.Remote Sensing Letters, 2019, 10(5):449-458.

[15] 赵小强,宋昭漾.Adam优化的CNN超分辨率重建［J］.计算机科学与探索,2019,13(5):858-865.

[16] GAO S K, GRUEV V.Bilinear and bicubic interpolation methods for division of focal plane polarimeters［J］.Optics Express, 2011, 19(27):161-173.

[17] 王昊榕.基于残差网络的图像超分辨率重建方法研究［D］.太原: 山西财经大学,2021.

[18] YUAN F, HUANG L F, YAO Y.An improved PSNR algorithm for objective video quality evaluation［C］//Proceedings of the 26th Chinese Control Conference.Beijing: Beihang University Press, 2007:376-380.

[19] ZHOU W, BOVIK A C, SHEIKH H R, et al.Image quality assessment:from error visibility to structural similarity［J］.IEEE Transactions on Image Processing:A Publication of the IEEE Signal Processing Society, 2004, 13(4):600-612.

邓伟, 陈建飞, 张胜. 深层跳线残差网络热红外图像超分辨重建[J]. 电光与控制, 2023, 30(3): 27. DENG Wei, CHEN Jianfei, ZHANG Sheng. Super-Resolution Reconstruction of Thermal Infrared Image in Deep Residual Network With Skip Connections[J]. Electronics Optics & Control, 2023, 30(3): 27.

深层跳线残差网络热红外图像超分辨重建

关于本站 Cookie 的使用提示

全站搜索

深层跳线残差网络热红外图像超分辨重建

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索