首页 > 论文 > 中国光学 > 8卷 > 4期(pp:582-588)

基于人脸姿态估计的虚拟眼镜试戴技术

Technology of virtual eyeglasses try-on system based on face pose estimation

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

为解决用户线上眼镜的最优选购, 提出了一种基于人脸姿态估计的虚拟眼镜试戴技术。首先采用肤色模型与形状模型结合的算法对场景中的人脸区域进行检测, 然后根据人眼在人脸中的几何位置关系实现人眼的精确定位; 进一步利用人眼对称性先验知识来估计脸在三维空间中的姿态信息, 即人脸与正面的偏移角度; 最后, 依据人眼位置和人脸姿态将眼镜图像融合到眼睛区域, 即完成眼镜的虚拟试戴。该方法为3D环境下客户与商品之间虚拟视觉化的实现提供了一种可靠的技术支撑和应用思路。

Abstract

In this paper, we present a new virtual eyeglasses try-on system based on face pose estimation, and provides technical support for the realization of the user online optimal commodity purchase. Firstly, we use color model combining shape model for face detection in the scene. Then, we use face geometry relationship to achieve precise positioning of the human eye. We furtherly estimate the face pose information based on a priori knowledge of the symmetrical of eyes in the face region, which is the deviation angle of face with the front side. Finally, we integrate the images of glasses to face and achieve the virtual eyeglasses try-on system according to calculating the angle and location information of eyes. This method provides a reliable technical support and application for the future implementation of virtual visualization between customers and goods in 3D environment.

Newport宣传-MKS新实验室计划
补充资料

中图分类号:TP391.4

DOI:10.3788/co.20150804.0582

所属栏目:信息光学

基金项目:教育部博士点基金资助项目(No.20120061110091)

收稿日期:2015-03-06

修改稿日期:2015-04-20

网络出版日期:--

作者单位    点击查看

卢洋:吉林大学 通信工程学院, 吉林 长春 130012
王世刚:吉林大学 通信工程学院, 吉林 长春 130012
赵文婷:吉林大学 通信工程学院, 吉林 长春 130012
武伟:吉林大学 通信工程学院, 吉林 长春 130012

联系人作者:王世刚(wangshigang@vip.sina.com)

备注:卢洋(1991—), 女, 河南焦作人, 硕士研究生, 2010年于吉林大学获得学士学位, 主要从事图像视频处理方面的研究。

【1】ZHANG Z,TONG T. Research on computer aided glasses selection and virtual try on[J]. Computer Engineering and Design,2007,30: 45-46.

【2】HJELMAS E. Face detection: a survey[J]. Computer Vision and Image Understanding,2001,83: 236-274.

【3】HUANG L,JIANG H,HUO G. Face recognition based on multi-scale feature extraction and multiple regression analysis[J]. Optics & Optoelectronic Technology,2012,6: 90-93.

【4】SHEN L,LANG B,ZHU M. Face recognition method based on artificial neural network[J]. Chinese J. Liquid Crystal and Displays,2011,6: 836-840.

【5】QUAN X,ZHANG L. Research on the face detection based on skin color model and eye location[J]. Science Technology and Engineering,2010,31: 7822-7824+7829.

【6】JI Q,HU R. 3D Face pose estimation and tracking from a monocular camera[J]. Image and Vision Computing,2002,20(7): 499-511.

【7】NIE X,TAN Z,GUO J. Face illumination compensation based on wavelet transform[J]. Optics and Precision Engineering. 2008,1: 150-155.

【8】HUANG B,TANG J. Novel method of eye detection in facial images[J]. Chinese J. Liquid Crystal and Displays,2009,2: 278-282.

【9】LIU M,GUO D,MA J,et al.. Face pose estimation based on elliptical model and neural network[J]. J. Jilin University(Science Edition),2008,7-11.

【10】LI J,YANG J. Eyeglasses try-on based on improved poisson equation[C]. 2011 International Conference Multimedia Technology. Hangzhou,China,2011: 3058-3061.

【11】BLACK M J,YACOOB Y. Tracking and recognizing rigid and non2rigid facial motions using local parametric models of image motion[C]. Fifth International Conference on Computer Vision. Cambridge,MA.USA,IEEE. 1995: 3742381.

【12】SCHWERDT K,CROWLEY J L. Robust face tracking using color[C]. Fourth IEEE International Conference on Automatic Face and Gesture Recognition.Grenoble,Frane,2000: 902-905.

引用该论文

LU Yang,WANG Shi-gang,ZHAO Wen-ting,WU Wei. Technology of virtual eyeglasses try-on system based on face pose estimation[J]. Chinese Optics, 2015, 8(4): 582-588

卢洋,王世刚,赵文婷,武伟. 基于人脸姿态估计的虚拟眼镜试戴技术[J]. 中国光学, 2015, 8(4): 582-588

被引情况

【1】郑明秋,杨 帆. 改进非负矩阵分解的神经网络人脸识别. 液晶与显示, 2017, 32(3): 213-218

【2】张兴春,孙寿健. 基于贝叶斯分类器的图像隐写分析. 液晶与显示, 2017, 32(7): 560-566

【3】杨明中,杨平先. 基于低秩特征脸与协同表示的人脸识别算法. 液晶与显示, 2017, 32(8): 650-655

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF