激光与光电子学进展, 2017, 54 (11): 111005, 网络出版: 2017-11-17   

基于优化卷积神经网络的图像超分辨率重建 下载: 1500次

Super-Resolution Reconstruction of Image Based on Optimized Convolution Neural Network
作者单位
西安建筑科技大学信息与控制工程学院, 陕西 西安 710055
摘要
与以往两类单帧图像的超分辨率重建方法相比,卷积神经网络超分辨率(SRCNN)技术以其端对端的映射架构大幅提高了运行效率与复原精准度,然而网络的层数限制以及收敛性能使得部分图像的恢复效果不及基于样例的重建方法。针对网络优化问题,提出了一种将粒子群优化(PSO)算法与SRCNN相结合的方法,利用PSO算法对网络权重进行初始化,同时结合梯度下降(GD)算法对权值进行修正,使得PSO算法的全局搜索能力与GD算法的局部寻优能力相融合。分别对set5、set14数据集和雾霾天气下模糊图片进行对比实验,结果表明,所提算法不仅能以较少参数来获得较高性能的网络,其重建效果优于已有的4种算法,而且对边缘的锐化能力更强。
Abstract
Compared with the previous two types of single-frame image super-resolution reconstruction algorithm, the super-resolution with convolution neural network (SRCNN) has greatly improved the operational efficiency and recovery accuracy with its end-to-end mapping structure. However, the number of hidden layers and the convergence performance of the network make the recovery effects of some images worse than the example-based reconstruction algorithms. In view of the problem of network optimization, the algorithm of combining particle swarm optimization (PSO) with SRCNN is proposed. PSO is used to initialize the network weight and the gradient descent (GD) algorithm is used to correct the weight which can combine the global search capability of PSO and the local search ability of GD. The experimental results of set5, set14 datasets and the blurred images under haze weather respectively show that the proposed algorithm can not only use less parameters to obtain higher performance network, but also has better reconstruction effect than the existing four algorithms, and the ability to sharpen edges is stronger.
参考文献

[1] 樊超, 孙宁宁, 夏旭. 基于序列图像的超分辨率重建[J]. 红外技术, 2010, 32(5): 279-282.

    Fan Chao, Sun Ningning, Xia Xu. Super-resolution reconstruction based on image sequences[J]. Infrared Technology, 2010, 32(5): 279-282.

[2] 杨爱萍, 白煌煌. 基于Retinex理论和暗通道先验的夜间图像去雾算法[J]. 激光与光电子学进展, 2017, 54(4): 041002.

    Yang Aiping, Bai Huanghuang. Nighttime image defogging based on the theory of Retinex and dark channel prior[J]. Laser & Optoelectronics Progress, 2017, 54(4): 041002.

[3] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2013, 39(8): 1202-1213.

    Su Heng, Zhou Jie, Zhang Zhihao. Survey of super-resolution image reconstruction methods[J]. Acta Automatica Sinica, 2013, 39(8): 1202-1213.

[4] 陈健, 高慧斌, 王伟国, 等. 图像超分辨率复原方法及应用[J]. 激光与光电子学进展, 2015, 52(2): 020004.

    Chen Jian, Gao Huibin, Wang Weiguo, et al. Methods and applications of image super-resolution restoration[J]. Laser & Optoelectronics Progress, 2015, 52(2): 020004.

[5] 周靖鸿, 周璀, 朱建军, 等. 基于非下采样轮廓波变换遥感影像超分辨重建方法[J]. 光学学报, 2015, 35(1): 0110001.

    Zhou Jinghong, Zhou Cui, Zhu Jianjun, et al. A method of super-resolution reconstruction for remote sensing image based on non-subsampled contourlet transform[J]. Acta Optica Sinica, 2015, 35(1): 0110001.

[6] 唐超影, 陈跃庭, 李奇, 等. 基于信号相关性的自适应时域视频压缩感知重建方法[J]. 光学学报, 2016, 36(10): 1010001.

    Tang Chaoying, Chen Yueting, Li Qi, et al. Adaptive temporal compressive sensing for video based on signal correlation[J]. Acta Optica Sinica, 2016, 36(10): 1010001.

[7] Dong C, Loy C G, He K, et al. Learning a deep convolutional network for image super-resolution[C]. European Conference on Computer Vision, 2014: 184-199.

[8] Yang J C, Wright J, Huang T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010, 19(11): 2861-2873.

[9] Timofte R, de Smet V, van Gool L. A+: adjusted anchored neighborhood regression for fast super-resolution[C]. Asian Conference on Computer Vision, 2014: 111-126.

[10] Yu D, Deng L. Deep learning and its applications to signal and information processing [exploratory dsp][J]. IEEE Signal Processing Magazine, 2011, 28(1): 145-154.

[11] Gan C, Wang N, Yang Y, et al. DevNet: a deep event network for multimedia event detection and evidence recounting[C].Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2015: 2568-2577.

[12] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition [EB/OL]. [2017-01-16]. https://arxiv.org/abs/1409.1556.

[13] He K, Sun J. Convolutional neural networks at constrained time cost[C]. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2015: 5353-5360.

[14] 张宝昌, 杨万扣, 林娜娜. 机器学习与视觉感知[M]. 北京: 清华大学出版社, 2016.

    Zhang Baochang, Yang Wankou, Lin Nana. Machine learning and visual perception[M]. Beijing: Tsinghua University Press, 2016.

[15] Nair V, Hinton G E. Rectified linear units improve restricted Boltzmann machines[C]. Proceedings of 27th International Conference on Machine Learning, 2010: 807-814.

[16] Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.

[17] 李彦冬, 郝宗波, 雷航. 卷积神经网络研究综述[J]. 计算机应用, 2016, 36(9): 2508-2514.

    Li Yandong, Hao Zongbo, Lei Hang. Survey of convolutional neural network[J]. Journal of Computer Applications, 2016, 36(9): 2508-2514.

[18] Bouvrie J. Note on convolutional neural networks[EB/OL].[2016-11-27]. http//cogprints.org/5869/1/c-nn_tutorial.pdf.

[19] Fu X L, Cai L H, Liu Y, et al. A computational cognition model of perception, memory, and judgment[J]. Science China-Information Sciences, 2014, 57(3): 032114.

[20] 王民, 宋正付, 王稚慧. 基于分形网络演化方法和改进模糊聚类遥感影像分割[J]. 激光与光电子学进展, 2016, 53(11): 112801.

    Wang Min, Song Zhengfu, Wang Zhihui. Remote sensing image segmentation based on fractal net evolution approach and improved fuzzy c-means[J]. Laser & Optoelectronics Progress, 2016, 53(11): 112801.

[21] 赵志刚, 林玉娇, 尹兆远. 基于自适应惯性权重的均值粒子群优化算法[J]. 计算机工程与科学, 2016, 38(3): 501-506.

    Zhao Zhigang, Lin Yujiao, Yin Zhaoyuan. A mean particle swarm optimization algorithm based on adaptive inertia weight[J]. Computer Engineering & Science, 2016, 38(3): 501-506.

[22] 卢昱璇. 基于卷积神经网络的图像超分辨率重建及视觉改进[D]. 合肥: 安徽大学, 2016: 5-27.

    Lu Yuxuan. Image super-resolution using convolutional networks and its visual improvement[D]. Hefei: Anhui University, 2016: 5-27.

[23] Liu L X, Liu B, Huang H, et al. No-reference image quality assessment based on spatial and spectral entropies[J]. Signal Processing Image Communication, 2014, 29(8): 856-863.

王民, 刘可心, 刘利, 杨润玲. 基于优化卷积神经网络的图像超分辨率重建[J]. 激光与光电子学进展, 2017, 54(11): 111005. Wang Min, Liu Kexin, Liu Li, Yang Runling. Super-Resolution Reconstruction of Image Based on Optimized Convolution Neural Network[J]. Laser & Optoelectronics Progress, 2017, 54(11): 111005.

本文已被 7 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!