液晶与显示, 2020, 35 (6): 547, 网络出版: 2020-10-27   

融合注意力机制的移动端人像分割网络

Mobile-based portrait segmentation network with attention mechanism
作者单位
1 平板显示技术国家地方联合工程实验室, 福州大学 物理与信息工程学院, 福建 福州 350108
2 晋江市博感电子科技有限公司, 福建 晋江 362200
摘要
现有的移动端人像分割网络存在分割精度差、分割边缘模糊等问题。为此, 提出了一种融合注意力机制的轻量化人像分割网络。首先, 利用MobileNetV2网络提取图像特征。然后对注意力模块NLNet(Non-local neural networks)进行轻量化处理, 随后将优化过的注意力模块嵌入到四层解码网络中。利用融合注意力机制的解码网络自适应地学习有效特征, 最后通过SoftMax层得到人像分割结果图。同时改进了损失函数, 引入多损失函数(Multi-Loss), 使网络更容易收敛。解码网络融合注意力机制的方式使得轻量化网络可以在语义分割任务上取得较好的效果。实验结果表明, 模型在550张自采集的人像测试集上达到了92.29%的交并比(MeanIOU),单张图片在Inter(R) Core i5 CPU上的分割时间为0.74 s。与传统的人像分割网络相比, 研究网络的分割精度和分割速度优势明显, 适合应用于移动端设备。
Abstract
Existing mobile terminal segmentation network has problems such as poor segmentation accuracy and segmentation edge blurring. To this end, a lightweight portrait segmentation network that incorporates attention mechanisms is proposed. Firstly, the image features are extracted by MobileNetV2 network. Then, the attention module NLNet (Non-local neural networks) is lightened, and then the optimized attention module is embedded in the four-layer decoding network. The decoding network with attention mechanism adaptively learns the effective features, and finally obtains the portrait segmentation result map through SoftMax. At the same time, the loss function is improved, and Multi-Loss (multi-loss function) is introduced to make the network easier to converge. The way of attention mechanisms fused in decoding networks makes the lightweight network achieve better results in the semantic segmentation task. Experimental results show that the model achieves 92.29% MeanIOU on the 550 self-collected portrait test set, and the split time of the single picture on the Inter(R) Core i5 CPU is 0.74 s. Compared with the traditional portrait segmentation network, the research network has obvious advantages in segmentation precision and segmentation speed, and is suitable for mobile devices.

周鹏, 姚剑敏, 林志贤, 严群, 郭太良. 融合注意力机制的移动端人像分割网络[J]. 液晶与显示, 2020, 35(6): 547. ZHOU Peng, YAO Jian-min, LIN Zhi-xian, YAN Qun, GUO Tai-liang. Mobile-based portrait segmentation network with attention mechanism[J]. Chinese Journal of Liquid Crystals and Displays, 2020, 35(6): 547.

本文已被 2 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!