基于软掩膜前景分割和多信息融合重排序的行人重识别方法

南方; 陈国钊; 朱艺璇; 殷健源

光学技术, 2023, 49 (6): 756, 网络出版: 2023-12-05

基于软掩膜前景分割和多信息融合重排序的行人重识别方法

Research on person re-identification algorithm based on soft mask foreground segmentation and multi information fusion re-ranking

论文大纲

南方 ^*陈国钊朱艺璇殷健源

作者单位

北京理工大学集成电路与电子学院, 北京 100081

行人重识别视频监控前景分割重排序 person re-identification video surveillance foreground segmentation re-ranking

摘要

为了提升行人重识别算法的检索准确率, 提出了基于软掩膜前景分割和多信息融合重排序的行人重识别算法。通过基于U-Net的软掩膜前景分割算法去除图像背景信息, 同时减缓图像分割边界的突变, 以保留图像中行人的关键信息; 通过基于孪生深度网络的多信息融合重排序算法融合行人图像的多种信息, 提升检索结果质量。实验结果表明, 提出的两种方法是对行人重识别算法流程的有效补充, 可作为提升准确率的有效方法应用于多数现有行人重识别算法中。

Abstract

In order to enhance the retrieval accuracy of person re-identification, a soft mask foreground segmentation and multi information fusion re-ranking based person re-identification algorithm is proposed. A foreground segmentation algorithm based on U-Net is employed to remove the background information of the image while mitigating the sharp boundary transitions in the image segmentation to preserve the key information of the person in the image. In addition, a multi-information fusion re-ranking algorithm based on the siamese deep network is utilized to improve the quality of the retrieval results. Experimental results demonstrate that the two proposed methods are effective supplements to the person re-identification process and can be applied as effective methods to improve accuracy in most existing person re-identification algorithms.

参考文献

[1] Wang X, Zhao R. Person re-identification: System design and evaluation overview［M］. London: Springer,2014:351-370.

[2] Song C, Huang Y, Ouyang W, et al. Mask-guided contrastive attention model for person re-identification［C］∥IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT, USA: IEEE,2018:1179-1188.

[3] Garcia J, Martinel N, Gardel A, et al. Discriminant context information analysis for post-ranking person re-identification［J］. IEEE Transactions on Image Processing,2017,26(4):1650-1665.

[4] Nguyen V-H, Ngo T D, Nguyen K M, et al. Re-ranking for person re-identification［C］∥International Conference on Soft Computing and Pattern Recognition. Hanoi, Vietnam:IEEE,2013:304-308.

[5] Ma A J, Li P. Query based adaptive re-ranking for person re-identification［C］∥Asian Conference on Computer Vision. Singapore: Springer,2014:397-412.

[6] Zheng L, Wang S, Tian L, et al. Query-adaptive late fusion for image search and person re-identification［C］∥IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA:IEEE,2015:1741-1750.

[7] Zheng L, Yang Y, Tian Q. SIFT meets CNN: A decade survey of instance retrieva［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,40(5):1224-1244.

[8] Li W, Wu Y, Mukunoki M, et al. Common-near-neighbor analysis for person re-identification［C］∥IEEE International Conference on Image Processing. Orlando, FL, USA:IEEE,2012:1621-1624.

[9] Garcia J, Martinel N, Micheloni C, et al. Person re-identification ranking optimisation by discriminant context information analysis［C］∥IEEE International Conference on Computer Vision. Santiago, Chile:IEEE,2015:1305-1313.

[10] Leng Q, Hu R, Liang C, et al. Person re-identification with content and context re-ranking［J］. Multimedia Tools and Applications,2015,74(17):6989-7014.

[11] Ye M, Chen J, Leng Q, et al. Coupled-view based ranking optimization for person re-identification［C］∥International Conference on Multimedia Modeling. Sydney, Australia:Springer,2015:105-117.

[12] Ye M, Liang C, Yu Y, et al. Person reidentification via ranking aggregation of similarity pulling and dissimilarity pushing［J］. IEEE Transactions on Multimedia,2016,18(12):2553-2566.

[13] Zhong Z, Zheng L, Cao D, et al. Re-ranking person re-identification with k-reciprocal encoding［C］∥IEEE Conference on Computer Vision and Pattern Recognition. Hawaii, USA:IEEE,2017:1318-1327.

[14] Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation［C］∥ International Conference on Medical Image Computing and Computer-assisted Intervention.Munich,Germany:Springer,2015:234-241.

[15] Zheng L, Shen L, Tian L, et al. Scalable person re-identification: A benchmark［C］∥IEEE International Conference on Computer Vision. Santiago, Chile:IEEE,2015:1116-1124.

[16] He K, Zhang X, Ren S, et al. Deep residual learning for image recognition［C］∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV,USA:IEEE,2016:770-778.

[17] Zhou K, Yang Y, Cavallaro A, et al. Omni-scale feature learning for person re-identification［C］∥IEEE/CVF International Conference on Computer Vision. Seoul, South Korea:IEEE,2019:3702-3712.

[18] Sun Y, Zheng L, Deng W, et al. Svdnet for pedestrian retrieval［C］∥Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy:IEEE,2017:3800-3808.

[19] Zhong Z, Zheng L, Zheng Z, et al. Camstyle: A novel data augmentation method for person re-identification［J］. IEEE Transactions on Image Processing,2018,28(3):1176-1190.

[20] Qian X, Fu Y, Xiang T, et al. Pose-normalized image generation for person re-identification［C］∥Proceedings of the European Conference on Computer Vision. Munich, Germany:Springer,2018:650-667.

[21] Lin Y, Zheng L, Zheng Z, et al. Improving person reidentification by attribute and identity learning［J］. Pattern Recognition,2019,95:151-161.

南方, 陈国钊, 朱艺璇, 殷健源. 基于软掩膜前景分割和多信息融合重排序的行人重识别方法[J]. 光学技术, 2023, 49(6): 756. NAN Fang, CHEN Guozhao, ZHU Yixuan, YIN jianyuan. Research on person re-identification algorithm based on soft mask foreground segmentation and multi information fusion re-ranking[J]. Optical Technique, 2023, 49(6): 756.

基于软掩膜前景分割和多信息融合重排序的行人重识别方法

关于本站 Cookie 的使用提示

全站搜索

基于软掩膜前景分割和多信息融合重排序的行人重识别方法

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索