液晶与显示, 2021, 36 (2): 293, 网络出版: 2021-03-30  

自适应动态肤色检测技术研究进展

Research progress of adaptive dynamic skin color detection technology
作者单位
1 天津大学 微电子学院, 天津 300072
2 海信视像科技股份有限公司, 山东 青岛 266071
摘要
肤色检测在人脸检测、手势识别、敏感图像过滤、医疗诊断、图像增强等计算机视觉和图像处理领域具有广泛的应用。由于人体肤色容易受光照条件、种族等因素的影响, 难以在非限制性场景中达到理想的肤色检测效果, 所以自适应肤色检测方法应运而生。本文较全面地对自适应肤色检测方法进行了综述, 重点分析了基于参数动态调整和基于高层语义特征的自适应肤色检测方法, 讨论了它们各自的优势和不足, 并在此基础之上展望了未来的发展趋势, 为相关研究人员提供参考。
Abstract
Skin color detection is widely used in face detection, gesture recognition, sensitive image filtering, medical diagnosis, image enhancement and so on. It is an important technology for computer vision and image processing fields. Because human skin color is easily affected by lighting conditions, races, etc., it is difficult to achieve ideal detection results under unconstrained environments. The emergence of adaptive methods makes the above problems improved. In this paper, adaptive skin detection methods are comprehensively reviewed. The paper focuses on the analysis of adaptive skin detection methods based on parameter dynamic adjustment and high-level semantic features. Meanwhile, it discusses their respective advantages and disadvantages. On this basis, the future development trend is prospected, which aims at providing reference for related researchers.
参考文献

[1] 林国军, 杨明中, 陈明举, 等.一种肤色定位的人脸检测算法[J].液晶与显示, 2019, 34(1): 70-73.

[2] WANG L, HU W M, TAN T N. Recent developments in human motion analysis [J]. Pattern Recognition, 2003, 36(3): 585-601.

[3] 谢非, 龚俊, 王元祥, 等.基于肤色增强和分块PCA的人脸表情识别方法[J].南京师范大学学报(工程技术版), 2017, 17(2): 49-56.

[4] 史东承, 倪康.基于YCbCr颜色空间背景建模与手势阴影消除[J].中国光学, 2015, 8(4): 589-595.

[5] WANG R B, GUO K Y, SHI S M, et al. A monitoring method of driver fatigue behavior based on machine vision [C]//IEEE IV2003 Intelligent Vehicles Symposium. Columbus: IEEE, 2003: 110-113.

[6] SHIFA A, IMTIAZ M B, ASGHAR M N, et al. Skin detection and lightweight encryption for privacy protection in real-time surveillance applications [J]. Image and Vision Computing, 2020, 94: 103859.

[7] 陈梦竹.基于肤色检测的中医面色识别[D].北京: 北京交通大学, 2018.

[8] JONES M J, REHG J M. Statistical color models with application to skin detection [J]. International Journal of Computer Vision, 2002, 46(1): 81-96.

[9] LEE J S, KUO Y M, CHUNG P C, et al. Naked image detection based on adaptive and extensible skin color model [J]. Pattern Recognition, 2007, 40(8): 2261-2270.

[10] 周结.2019年中国网络视听发展研究报告[EB/OL].(2019-05-27) [2020-07-12]. https: //www.sohu.com/a/316802357_728306.

[11] ZAFARIFAR B, BELLERS E B, DE WITH P H N. Application and evaluation of texture-adaptive skin detection in TV image enhancement [C]//2013 IEEE International Conference on Consumer Electronics. Las Vegas: IEEE, 2013: 88-91.

[12] CHEN H S, WANG T M, CHEN S H, et al. Skin-color correction method based on hue template mapping for wide color gamut liquid crystal display devices [J]. Color Research and Application, 2011, 36(5): 335-348.

[13] 陈锻生, 刘政凯.肤色检测技术综述[J].计算机学报, 2006, 29(2): 194-207.

[14] 郑燕, 张霞.基于像素的肤色检测方法综述[J].计算机系统应用, 2020, 29(3): 1-10.

[15] NAJI S, JALAB H A, KAREEM S A. A survey on skin detection in colored images [J]. Artificial Intelligence Review, 2019, 52(2): 1041-1087.

[16] SUN H M. Skin detection for single images using dynamic skin color modeling [J]. Pattern Recognition, 2010, 43(4): 1413-1420.

[17] HSU R L, ABDEL-MOTTALEB M, JAIN A K. Face detection in color images [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5): 696-706.

[18] LUMINI A, NANNI L. Fair comparison of skin detection approaches on publicly available datasets [J]. Expert Systems with Applications, 2020, 160: 113677.

[19] BADRINARAYANAN V, KENDALL A, CIPOLLA R. Segnet: a deep convolutional encoder-decoder architecture for image segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12): 2481-2495.

[20] RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation [C]//18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 2015: 234-241.

[21] CHEN L C, ZHU Y K, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation [C]//Proceedings of the 15th European Conference on Computer Vision. Cham: Springer, 2018: 801-818.

[22] DOURADO A, GUTH F, DE CAMPOS T E, et al. Domain adaptation for holistic skin detection [J]. arXiv preprint arXiv: 1903.06969, 2019.

[23] HE Y, SHI J Y, WANG C, et al. Semi-supervised skin detection by network with mutual guidance [C]//Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019: 2111-2120.

[24] SCHMUGGE S J, JAYARAM S, SHIN M C, et al. Objective evaluation of approaches of skin detection using ROC analysis [J]. Computer Vision and Image Understanding, 2007, 108(1/2): 41-51.

[25] WIMMER M, RADIG B. Adaptive skin color classificator [C]//Proceedings of the first ICGST International Conference on Graphics Vision and Image Processing GVIP-05. Cairo, Egypt: CICC, 2005, 1: 324-327.

[26] 陶霖密, 彭振云, 徐光祐, 等.人体的肤色特征[J].软件学报, 2001, 12(7): 1032-1041.

[27] JAYARAM S, SCHMUGGE S, SHIN M C, et al. Effect of colorspace transformation, the illuminance component, and color modeling on skin detection [C]//Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. Washington: IEEE, 2004: 813-818.

[28] GARCIA C, TZIRITAS G. Face detection using quantized skin color regions merging and wavelet packet analysis [J]. IEEE Transactions on Multimedia, 1999, 1(3): 264-277.

[29] CHO K M, JANG J H, HONG K S. Adaptive skin-color filter [J]. Pattern Recognition, 2001, 34(5): 1067-1073.

[30] SORIANO M, MARTINKAUPPI B, HUOVINEN S, et al. Adaptive skin color modeling using the skin locus for selecting training pixels [J]. Pattern Recognition, 2003, 36(3): 681-90.

[31] FOOPRATEEPSIRI R, KURUTACH W. A general framework for face reconstruction using single still image based on 2D-to-3D transformation kernel [J]. Forensic Science International, 2014, 236: 117-126.

[32] 郭耸, 顾国昌, 蔡则苏, 等.肤色相似度和动态阈值相结合的肤色分割技术[J].计算机工程与应用, 2010, 46(18): 1-3, 12.

[33] 张明吉, 王伟强, 郑清芳, 等.静态图像中的自适应阈值肤色检测算法[J].计算机研究与发展, 2006, 43(9): 1674-1680.

[34] PHUNG S L, CHAI D, BOUZERDOUM A. Adaptive skin segmentation in color images [C]//Proceedings of the 2003 International Conference on Multimedia and Expo. Baltimore: IEEE, 2003: III-173.

[35] 李晓光, 李晓华, 沈兰荪.一种DCT压缩域中基于三维椭圆模型的自适应肤色分割算法[J].电子学报, 2005, 33(12A): 2464-2467.

[36] 夏思宇, 李久贤, 袁晓辉, 等.一种改进的自适应肤色检测算法[J].数据采集与处理, 2006, 21(2): 174-178.

[37] 曾飞, 蔡灿辉.自适应肤色检测算法的研究[J].微型机与应用, 2011, 30(4): 37-40.

[38] 熊霞, 桑庆兵.光照自适应的肤色检测方法[J].计算机应用, 2011, 31(5): 1233-1236.

[39] 张情, 黎明, 冷璐.结合自适应肤色模型和区域生长的掌纹分割[J].计算机工程与设计, 2017, 38(10): 2794-2798.

[40] 江国来, 林耀荣.自适应模型和固定模型结合的肤色分割算法[J].计算机应用, 2010, 30(10): 2698-2701.

[41] KHAN R, HANBURY A, STTTINGER J, et al. Multiple color space channel fusion for skin detection [J]. Multimedia Tools and Applications, 2014, 72(2): 1709-1730.

[42] GUPTA A, CHAUDHARY A. Robust skin segmentation using color space switching [J]. Pattern Recognition and Image Analysis, 2016, 26(1): 61-68.

[43] GOMEZ G. On selecting colour components for skin detection [C]//Object Recognition Supported by User Interaction for service robots. Quebec City: IEEE, 2002, 2: 961-964.

[44] BRANCATI N, DE PIETRO G, FRUCCI M, et al. Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering [J]. Computer Vision and Image Understanding, 2017, 155: 33-42.

[45] HSIEH C C, LIOU D H, LAI W R. Enhanced face-based adaptive skin color model [J]. Journal of Applied Science and Engineering, 2012, 15(2): 167-176.

[46] YOGARAJAH P, CONDELL J, CURRAN K, et al. A dynamic threshold approach for skin segmentation in color images [C]//2010 IEEE International Conference on Image Processing. Hong Kong: IEEE, 2010: 2225-2228.

[47] TAN W R, CHAN C S, YOGARAJAH P, et al. A fusion approach for efficient human skin detection [J]. IEEE Transactions on Industrial Informatics, 2012, 8(1): 138-147.

[48] FASEL I, FORTENBERRY B, MOVELLAN J. A generative framework for real time object detection and classification [J]. Computer Vision and Image Understanding, 2005, 98(1): 182-210.

[49] 方晶晶, 李振波, 姜宇.人体肤色区域的自适应模型分割方法[J].计算机辅助设计与图形学学报, 2013, 25(2): 229-234.

[50] LUO Y, GUAN Y P. Adaptive skin detection using face location and facial structure estimation [J]. IET Computer Vision, 2017, 11(7): 550-559.

[51] ZHU Q, CHENG K T, WU C T. A unified adaptive approach to accurate skin detection [C]//2004 International Conference on Image Processing. Singapore: IEEE, 2004: 1189-1192.

[52] MOHANTY R, RAGHUNADH M V. Skin color segmentation based face detection using multi-color space [J]. International Journal of Advanced Research in Computer and Communication Engineering, 2016, 5(5): 470-475.

[53] BIANCO S, GASPARINI F, SCHETTINI R. Adaptive skin classification using face and body detection [J]. IEEE Transactions on Image Processing, 2015, 24(12): 4756-4765.

[54] VIOLA P, JONES M. Rapid object detection using a boosted cascade of simple features [C]//Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Kauai: IEEE, 2001, 1: I.

张坤, 王烨东, 李文元, 李昌禄, 雷志春. 自适应动态肤色检测技术研究进展[J]. 液晶与显示, 2021, 36(2): 293. ZHANG Kun, WANG Ye-dong, LI Wen-yuan, LI Chang-lu, LEI Zhi-chun. Research progress of adaptive dynamic skin color detection technology[J]. Chinese Journal of Liquid Crystals and Displays, 2021, 36(2): 293.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!