激光与光电子学进展, 2024, 61 (4): 0411003, 网络出版: 2024-02-06  

基于交错组卷积与稀疏全局注意力的轻量级图像超分辨率重建

Lightweight Image Super-Resolution Based on Shuffle Group Convolution and Sparse Global Attention
作者单位
上海工程技术大学电子电气工程学院,上海 201620
摘要
卷积神经网络已在图像超分辨率领域得到广泛应用,Transformer近年来在该类图像处理任务中的扩展更是具有里程碑的意义,然而这些大型网络具有过多的参数量和计算量,其在部署和应用上存在很大局限性。考虑到上述发展现状,提出一种基于交错组卷积与稀疏全局注意力的轻量级图像超分辨率重建网络,该网络引入了以交错组卷积为主的特征提取模块,对Transformer的多头自注意力机制进行优化,设计了一种稀疏全局注意力机制以增强特征学习能力,并提出了一种多尺度特征重构模块来提高重建效果。实验结果表明:相比其他几种基于深度神经网络的方法,所提方法的PSNR、SSIM、参数量、计算量等性能指标都表现较好。而与基于Transfomer的方法相比,所提方法在PSNR、SSIM指标上平均提高0.03、0.0002,在参数量、计算量、运行时间上平均降低2.66×106、130×109、930 ms。
Abstract
Convolutional neural networks have been widely used in the field of image super-resolution, and the expansion of the transformer in such image processing tasks is a milestone in recent years. However, these large networks have excessive parameters and entail a large amount of computation, limiting their deployment and application. Given the above development status, a network based on staggered group convolution and sparse global attention lightweight image super-resolution reconstruction is proposed. A staggered group convolution feature extraction module is introduced in the network and in the transformer to improve attention mechanism optimization, and a sparse global attention mechanism is designed to enhance the feature learning ability. A multiscale feature reconstruction module is put forward to improve the reconstruction effect. The experiments show that compared with several other methods based on deep neural networks,the proposed method performs better in the peak signal to noise ratio (PSNR), structural index similarity (SSIM), parameter quantity, amount of calculation, and other performance indicators. Compared with the Transfomer-based method, the proposed method has an average increase of 0.03 and 0.0002 in PSNR and SSIM, respectively, and an average decrease of 2.66×106、130×109, and 930 ms in parameter quantity, amount of calculation, and running time, respectively.

李想, 张娟. 基于交错组卷积与稀疏全局注意力的轻量级图像超分辨率重建[J]. 激光与光电子学进展, 2024, 61(4): 0411003. Xiang Li, Juan Zhang. Lightweight Image Super-Resolution Based on Shuffle Group Convolution and Sparse Global Attention[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0411003.

引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!