中国激光, 2017, 44 (12): 1200001, 网络出版: 2017-12-11   

焊接领域激光结构光视觉传感技术的研究及应用 下载: 1073次

Research and Application of Visual Sensing Technology Based on Laser Structured Light in Welding Industry
作者单位
清华大学机械工程系先进成形制造教育部重点实验室, 北京 100084
摘要
基于激光结构光的视觉传感技术是实现焊接坡口检测、焊缝跟踪和焊接机器人路径规划等的主要技术手段和基础。介绍了基于激光结构光的视觉传感技术应用于焊接领域的优势, 分析了其基本检测原理, 归纳总结了该技术在焊接领域的研究热点和发展方向。通过探讨各种激光结构光视觉传感器的原理和特征, 对其进行了全面的总结和全新的分类, 并详细介绍了它们各自的技术特点及研究进展。最后, 对基于激光结构光的视觉传感技术存在的问题进行了探讨, 以期促进该技术的进一步研究和应用。
Abstract
The visual sensing technologies based on the laser structured light are the main technical means and foundation for the realization of welding groove detection, seam tracking and robot path planning in the welding industry. Their technical advantages applied in the welding industry are introduced, the basic detection principles are analyzed, and the research focuses and developing directions in the welding industry are concluded and summarized. Through discussion on the operational principles and characteristics of various visual sensors based on the laser structured light, the comprehensive summary and a novel classification are proposed, and their respective technical characteristics and research progress are introduced in detail. Finally, the existing problems of visual sensing technology based on the laser structured light are discussed in order to promote further research and application of this technology.
参考文献

[1] 林尚扬. 我国焊接生产现状与焊接技术的发展[J]. 船舶工程, 2005, 27(s1): 15-24.

    Lin Shangyang. Present situation of welding production and development trend of welding technology in China[J]. Ship Engineering, 2005, 27(s1): 15-24.

[2] 申俊琦. 基于激光视觉传感的CO2横焊焊缝图像处理研究[D]. 天津: 天津大学, 2010.

    Shen Junqi. Research on seam image processing for CO2 horizontal position welding based on laser vision sensing[D]. Tianjin: Tianjin University, 2010.

[3] 王伟, 邹奇仕, 朱六妹, 等. 视觉传感焊缝跟踪技术的发展状况及实施方案探讨[J]. 电焊机, 2002, 32(5): 1-8.

    Wang Wei, Zou Qishi, Zhu Liumei, et al. The development state and implementing method of seam tracking system with optical sensor[J]. Electric Welding Machine, 2002, 32(5): 1-8.

[4] Marr D. Vision: a computational investigation into the human representation and processing of visual information[M]. New York: Henry Holt and Co., 1982.

[5] 邹怡蓉. 面向焊缝视觉识别及自动跟踪的多特征获取与信息融合[D]. 北京: 清华大学, 2012.

    Zou Yirong. Research on visual method for weld seam recognition and tracking based on multi-feature extraction and information fusion[D]. Beijing: Tsinghua University, 2012.

[6] 厉阳春. 计算机主动视觉理论研究[J]. 咸宁学院学报, 2008, 28(6): 63-66.

    Li Yangchun. Research on computer active vision theory[J]. Journal of Xianning College, 2008, 28(6): 63-66.

[7] 吴彰良, 孙长库, 杨中东. 视觉测量传感器系统结构参数设计分析[J]. 光电工程, 2009, 36(12): 56-61.

    Wu Zhangliang, Sun Changku, Yang Zhongdong. Analysis and design of structure parameters of vision measuring sensor system[J]. Opto-Electronic Engineering, 2009, 36(12): 56-61.

[8] 万瑾, 黄元庆. 激光三角法测量的研究[J]. 三明学院学报, 2006, 23(4): 361-364.

    Wan Jin, Huang Yuanqing. Study on laser triangulation method measurement[J]. Journal of Sanming University, 2006, 23(4): 361-364.

[9] 郭志鹏, 于治水, 张培磊, 等. 基于视觉传感的焊缝跟踪系统研究现状[J]. 轻工机械, 2016, 34(5): 95-100.

    Guo Zhipeng, Yu Zhishui, Zhang Peilei, et al. Research status of seam tracking technology based on visual sensing[J]. Light Industry Machinery, 2016, 34(5): 95-100.

[10] 邹焱飚, 龚国基. 面向焊缝跟踪的线激光检测技术研究[J]. 应用激光, 2015, 35(4): 500-507.

    Zou Yanbiao, Gong Guoji. Researcher on line laser detecting technology for seam tracking[J]. Applied Laser, 2015, 35(4): 500-507.

[11] 邾继贵, 郭磊, 刘常杰, 等. 基于机器人的柔性电子检具测量系统[J]. 光学 精密工程, 2011, 19(8): 1787-1793.

    Zhu Jigui, Guo Lei, Liu Changjie, et al. Measurement system of flexible electronic checking fixture on robot[J]. Optics and Precision Engineering, 2011, 19(8): 1787-1793.

[12] Fennander H, Kyrki V, Fellman A, et al. Visual measurement and tracking in laser hybrid welding[J]. Machine Vision & Applications, 2009, 20(2): 103-118.

[13] 石玗, 汪海涛, 薛诚, 等. 采用激光线光源的焊接坡口间隙视觉检测[J]. 兰州理工大学学报, 2009, 35(6): 29-32.

    Shi Yu, Wang Haitao, Xue Cheng, et al. Visual detection of welding groove gap with linear laser source[J]. Journal of Lanzhou University of Technology, 2009, 35(6): 29-32.

[14] 刘习文, 洪波, 戴铁峰. 激光视觉焊缝跟踪图像处理与坡口识别[J]. 激光与红外, 2011, 41(7): 804-807.

    Liu Xiwen, Hong Bo, Dai Tiefeng. Image processing and groove recognition in weld seam tracking based on laser vision[J]. Laser & Infrared, 2011, 41(7): 804-807.

[15] 赵素娟. 激光视觉传感焊缝识别与自动跟踪系统[D]. 长春: 长春工业大学, 2015.

    Zhao Sujuan. Research on laser of seam detection and automatic seam tracking system[D]. Changchun: Changchun University of Technology, 2015.

[16] 周律. 基于视觉伺服的弧焊机器人焊接路径获取方法研究[D]. 上海: 上海交通大学, 2007.

    Zhou Lü. Research on the acquisition method of welding path for arc welding robot based on visual servoing[D]. Shanghai: Shanghai Jiao Tong University, 2007.

[17] Yu J Y, Na S J. A study on vision sensors for seam tracking of height-varying weldment: Part 1 mathematical model[J]. Mechatronics, 1997, 7(7): 599-612.

[18] Yu J Y, Na S J. A study on vision sensors for seam tracking of height-varying weldment: Part 2 applications[J]. Mechatronics, 1998, 8(1): 21-36.

[19] 闫文才. 视觉引导的焊接机器人焊缝跟踪控制技术的研究与开发[D]. 无锡: 江南大学, 2014.

    Yan Wencai. Research and development of robot welding seam tracking control technology based on visual guide[D]. Wuxi: Jiangnan University, 2014.

[20] 李永哲. 基于结构光视觉传感的GMAW快速成形焊道形貌检测及控制[D]. 哈尔滨: 哈尔滨工业大学, 2012.

    Li Yongzhe. On-line detection and control system of GMAW rapid prototyping process based on structured light[D]. Harbin: Harbin Institute of Technology, 2012.

[21] 汪岩峰, 刘南生, 林浩亮, 等. 基于结构光投影的焊接熔池图像获取与处理[J]. 焊接学报, 2008, 29(10): 81-84.

    Wang Yanfeng, Liu Nansheng, Lin Haoliang, et al. Image taking and processing of welding pool based on structured light projection[J]. Transactions of the China Welding Institution, 2008, 29(10): 81-84.

[22] 张华军, 张广军, 蔡春波, 等. 机器人多层多道焊缝激光视觉焊道的识别[J]. 焊接学报, 2009, 30(4): 105-108.

    Zhang Huajun, Zhang Guangjun, Cai Chunbo, et al. Laser-based visual recognition of multi-pass seam in robot arc welding[J]. Transactions of the China Welding Institution, 2009, 30(4): 105-108.

[23] 黎咸西. 基于视觉的多层多道焊缝跟踪[D]. 南昌: 南昌航空大学, 2011.

    Li Xianxi. Multipass seam tracking based on vision sensor[D]. Nanchang: Nanchang Hangkong University, 2011.

[24] 王志江, 张广军, 梁志敏, 等. 熔池表面三维检测与测量技术现状及发展趋势[J]. 焊接, 2007(8): 15-19.

    Wang Zhijiang, Zhang Guangjun, Liang Zhimin, et al. Current status and development trend of tridimensional monitoring and measurement technology for weld pool surface[J]. Welding & Joining, 2007(8): 15-19.

[25] 王志江, 张广军, 张裕明, 等. 非熔化极气体保护焊接熔池表面形貌三维传感及其装置设计[J]. 机械工程学报, 2008, 44(10): 300-303.

    Wang Zhijiang, Zhang Guangjun, Zhang Yuming, et al. 3D sensing of gas tungsten arc weld pool surface and sensing device design[J]. Chinese Journal of Mechanical Engineering, 2008, 44(10): 300-303.

[26] Song H S, Zhang Y M. Measurement and analysis of three-dimensional specular gas tungsten arc weld pool surface[J]. Welding Journal, 2008, 87(4): 85s-95s.

[27] Wang Z, Zhang Y M, Yang R. Analytical reconstruction of three-dimensional weld pool surface in GTAW[J]. Journal of Manufacturing Processes, 2013, 15(1): 34-40.

[28] Saeed G, Lou M, Zhang Y M. Computation of 3D weld pool surface from the slope field and point tracking of laser beams[J]. Measurement Science & Technology, 2003, 15(2): 389-403.

[29] Luo M, Shin Y C. Vision-based weld pool boundary extraction and width measurement during keyhole fiber laser welding[J]. Optics and Lasers in Engineering, 2015, 64(12): 59-70.

[30] 杨建华. 基于线结构光视觉传感器的三维表面测量系统关键技术研究[D]. 广州: 广东工业大学, 2013.

    Yang Jianhua. Key technologies research on 3D surface measurement system based on linear structured light vision sensor[D]. Guangzhou: Guangdong University of Technology, 2013.

[31] 解则晓, 陈文柱, 迟书凯, 等. 基于结构光视觉引导的工业机器人定位系统[J]. 光学学报, 2016, 36(10): 1015001.

    Xie Zexiao, Chen Wenzhu, Chi Shukai, et al. Industrial robot positioning system based on the guidance of the structured-light vision[J]. Acta Optica Sinica, 2016, 36(10): 1015001.

[32] 张广军. 机器视觉[M]. 北京: 科学出版社, 2005.

    Zhang Guangjun. Machine vision[M]. Beijing: Science Press, 2005.

[33] 乔东虓, 郑军, 潘际銮. 双线结构光焊缝跟踪传感器及其特性[J]. 电焊机, 2010, 40(11): 14-16.

    Qiao Dongxiao, Zheng Jun, Pan Jiluan. Dual structure laser vision sensor and its character[J]. Electric Welding Machine, 2010, 40(11): 14-16.

[34] 毛志伟, 周少玲, 赵滨, 等. 双线激光传感焊枪定位与焊缝走向识别[J]. 焊接学报, 2015, 36(2): 35-38.

    Mao Zhiwei, Zhou Shaoling, Zhao Bin, et al. Welding torch position and seam orientation deviation based on two stripes laser vision sensing[J]. Transactions of the China Welding Institution, 2015, 36(2): 35-38.

[35] Xiao Z. Research on a trilines laser vision sensor for seam tracking in welding[J]. Lecture Notes in Electrical Engineering, 2011, 88: 139-144.

[36] Sung K, Lee H, Choi Y S, et al. Development of a multiline laser vision sensor for joint tracking in welding[J]. Welding Journal, 2009, 88(4): 79s-85s.

[37] 徐培全, 唐新华, 卢凤桂, 等. 基于环形激光视觉传感的焊缝自动定位方法: CN200510030453.X[P]. 2005-10-13.

[38] Xu P, Xu G, Tang X, et al. A visual seam tracking system for robotic arc welding[J]. International Journal of Advanced Manufacturing Technology, 2008, 37(1/2): 70-75.

[39] Xu P, Tang X, Yao S. Application of circular laser vision sensor (CLVS) on welded seam tracking[J]. Journal of Materials Processing Technology, 2008, 205(1/2/3): 404-410.

[40] Will P M, Pennington K S. Grid coding: a preprocessing technique for robot and machine vision[J]. Artificial Intelligence, 1971, 2(3): 319-329.

[41] 金明. 结构光多视角测量技术的研究[D]. 青岛: 中国海洋大学, 2008.

    Jin Ming. Study on structured light multi-view measurement[D]. Qingdao: Ocean University of China, 2008.

[42] 王宗义. 线结构光视觉传感器与水下三维探测[D]. 哈尔滨: 哈尔滨工程大学, 2005.

    Wang Zongyi. Structured light sensor and underwater 3D inspecting system[D]. Harbin: Harbin Engineering University, 2005.

[43] Boyer K L, Kak A C. Color-encoded structured light for rapid active ranging[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2009, 9(1): 14-28.

[44] 卫善春. 基于视觉传感的初始焊接位置自主导引研究[D]. 上海: 上海交通大学, 2009.

    Wei Shanchun. Study of autonomous guidance of initial welding position based on vision sensing[D]. Shanghai: Shanghai Jiao Tong University, 2009.

[45] 王克鸿, 杨嘉佳, 孙科. 基于视觉的焊接三维重建技术研究现状[J]. 机械制造与自动化, 2013, 42(1): 1-5.

    Wang Kehong, Yang Jiajia, Sun Ke. The research status of visual-based three-dimensional reconstruction technology in welding[J]. Machine Building & Automation, 2013, 42(1): 1-5.

[46] 李学瑞. 基于激光双目视觉的焊接机器人波纹板焊缝三维重建的研究[D]. 广州: 华南理工大学, 2014.

    Li Xuerui. Research of three-dimensional reconstruction of corrugated board weld seam based on laser binocular vision for arc welding robot[D]. Guangzhou: South China University of Technology, 2014.

[47] 陈熙引. 基于双目视觉的机器人焊缝识别及轨迹规划研究[D]. 广州: 华南理工大学, 2015.

    Chen Xiyin. Research on seam recognition and path planning of robot based on binocular vision[D]. Guangzhou: South China University of Technology, 2015.

[48] Zhang T, Liu J, Liu S, et al. A 3D reconstruction method for pipeline inspection based on multi-vision[J]. Measurement, 2017, 98: 35-48.

[49] Jia Z, Wang L, Liu W, et al. A field measurement method for large objects based on a multi-view stereo vision system[J]. Sensors & Actuators A: Physical, 2015, 234: 120-132.

[50] 李德玲. 基于激光结构光的视觉焊缝跟踪系统研究[D]. 郑州: 河南工业大学, 2014.

    Li Deling. Investigation on visual seam tracking system based on laser structured light[D]. Zhengzhou: Henan University of Technology, 2014.

[51] 邹媛媛, 赵明扬, 张雷, 等. 结构光视觉传感器误差分析与结构分析[J]. 仪器仪表学报, 2008, 29(12): 2605-2610.

    Zou Yuanyuan, Zhao Mingyang, Zhang Lei, et al. Error analysis and structural analysis of structured-light visual sensor for seam tracking[J]. Chinese Journal of Scientific Instrument, 2008, 29(12): 2605-2610.

[52] 王含宇, 韩冲, 张碧超. 结构光焊缝跟踪传感器设计的关键问题[J]. 电焊机, 2013, 43(8): 1-7.

    Wang Hanyu, Han Chong, Zhang Bichao. Key technology for designing weld seam tracking system based on the structured light method[J]. Electric Welding Machine, 2013, 43(8): 1-7.

[53] 刘南生, 郭昌荣, 刘明友, 等. 爬行式弧焊机器人结构光视觉传感器内部布局实验研究[J]. 江西科学, 2005, 23(4): 325-327.

    Liu Nansheng, Guo Changrong, Liu Mingyou, et al. The internal layout experiment research of structural light visual sensor used in crawling arc welding robot[J]. Jiangxi Science, 2005, 23(4): 325-327.

[54] Flandin G, Chaumette F, Marchand E. Eye-in-hand/eye-to-hand cooperation for visual servoing[C]. IEEE International Conference on Robotics and Automation, San Francisco, 2000, 3: 2741-2746.

郭吉昌, 朱志明, 于英飞, 孙博文. 焊接领域激光结构光视觉传感技术的研究及应用[J]. 中国激光, 2017, 44(12): 1200001. Guo Jichang, Zhu Zhiming, Yu Yingfei, Sun Bowen. Research and Application of Visual Sensing Technology Based on Laser Structured Light in Welding Industry[J]. Chinese Journal of Lasers, 2017, 44(12): 1200001.

本文已被 15 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!