激光与光电子学进展, 2021, 58 (8): 0810018, 网络出版: 2021-04-12
基于区域自我注意力的实时语义分割网络 下载: 799次
Real-Time Semantic Segmentation Network Based on Regional Self-Attention
图像处理 语义分割 卷积神经网络 注意力机制 image processing semantic segmentation convolutional neural networks attention mechanism
摘要
高精度的语义分割结果往往依赖于丰富的空间语义信息与细节信息,但这两者的计算量均较大。为了解决该问题,通过分析图像局部像素具有的相似性,提出了一种基于区域自我注意力的实时语义分割网络。该网络可分别通过一个区域级的自我注意力模块和一个局部交互通道注意力模块计算出特征信息的区域级关联性和通道注意力信息,然后以较少的计算量获取丰富的注意力信息。在Cityscapes数据集上的实验结果表明,相比现有的实时分割网络,本网络的分割精度更高、速度更快。
Abstract
High accuracy results of semantic segmentation often rely on rich spatial semantic information and detailed information, but both incurring high computational costs. In order to solve this problem, we propose a real-time semantic segmentation network based on regional self-attention by observing the similarity of local pixels in the image. The network can calculate the regional correlation of feature information and channel attention information through a regional self-attention module and a local interactive channel attention module. Then, it obtains rich attention information with less calculation. The experimental results on the Cityscapes dataset show that the segmentation accuracy and speed of the network are higher than the existing real-time segmentation network.
鲍海龙, 万敏, 刘忠祥, 秦勉, 崔浩宇. 基于区域自我注意力的实时语义分割网络[J]. 激光与光电子学进展, 2021, 58(8): 0810018. Hailong Bao, Min Wan, Zhongxiang Liu, Mian Qin, Haoyu Cui. Real-Time Semantic Segmentation Network Based on Regional Self-Attention[J]. Laser & Optoelectronics Progress, 2021, 58(8): 0810018.