激光技术, 2023, 47 (5): 723, 网络出版: 2023-12-11  

激光焊缝图像分割与颜色识别方法研究

Research on image segmentation and color recognition method of laser weld
作者单位
南昌航空大学 信息工程学院, 南昌 330063
摘要
为了减少激光焊缝语义分割中焊缝形状和颜色多样性对分割精度的影响, 采用注意力机制的图像语义分割方法提取焊缝区域。通过把焊缝区域图像从RGB转变到HSV颜色空间, 在HSV模型空间实现对焊缝表面颜色识别, 分析了3种类型焊缝对区域分割和颜色识别的影响。结果表明, 焊缝分割区域平均像素精度约为91.2%, 添加注意力机制U型网络模型的分割效果更好。此焊缝表面颜色自动识别结果符合生产要求, 在工业生产中有广泛应用前景。
Abstract
In order to reduce the influence of weld shape and color diversity on segmentation accuracy in laser weld semantic segmentation, an image semantic segmentation method based on attention mechanism was used to extract weld. The image in the weld was converted from RGB(red, green, blue) to HSV(hue, saturation, value) color space, and the weld surface color was recognized in HSV. The effects of three kinds of welds on region segmentation and color recognition were analyzed. The results show that the average pixel accuracy of the weld segmentation region is about 91.2%, and the segmentation effect of the attention U-Net model with attention mechanism is better. The results of automatic identification of weld surface color meet production requirements, and have broad application prospects in industrial production.
参考文献

[1] LI H. Analysis and control of laser weld crack[C]//2020 3rd International Conference on Electron Device and Mechanical Engineering (ICEDME). New York,USA:IEEE, 2020: 192-195.

[2] LI X, XIE J, ZHOU Y. Effects of oxygen contamination in the argon shielding gas in laser welding of commercially pure titanium thin sheet[J]. Journal of Materials Science, 2005, 40(13): 3437-3443.

[3] HARWIG D D, FOUNTAIN C, ITTIWATTANA W, et al. Oxygen equivalent effects on the mechanical properties of titanium welds[J]. Welding Journal Research Supplement, 2000, 79(11): 305s-316s.

[4] FAN L M, GENG N T, YANG L, et al. Progress of anti-oxidation protection technology in titanium alloy welding process[J]. Iron Steel Vanadium Titanium, 2021, 42(6): 43-50(in Chinese).

[5] GUPTA S S, KWON T H, KIM K D. Color based image processing techniques to detect oxide film during welding[C]//2020 International Conference on Electronics, Information, and Communication (ICEIC). New York,USA:IEEE, 2020: 1-4.

[6] HUA S, LI B, SHU L, et al. Defect detection method using laser vision with model-based segmentation for laser brazing welds on car body surface[J]. Measurement, 2021, 178: 109370.

[7] QI J Y, LI J Y, LU Zh Y, et al. Application of improved Otsu algorithm to welding image segmentation[J]. Transaction of the China Welding Institution,2016,37(10):97-100(in Chinese).

[8] MALARVEL M, SETHUMADHAVAN G, BHAGI P C R, et al. An improved version of Otsu’s method for segmentation of weld defects on X-radiography images[J]. Optik, 2017, 142: 109-118.

[9] DAI X L, MAO Y Sh, ZHOU Y Q. Weld segmentation algorithm based on improved watershed[J]. Ship Engineer,2021,43(s1):428-433(in Chinese).

[10] ANAND R S, KUMAR P. Flaw detection in radiographic weldment images using morphological watershed segmentation technique[J]. NDT & E International, 2009, 42(1): 2-8.

[11] RADI D, ABO-ELSOUD M E A, KHALIFA F. Accurate segmentation of weld defects with horizontal shapes[J]. NDT & E International, 2022, 126: 102599.

[12] XU H, YAN Z H, JI B W, et al. Defect detection in welding radiographic images based on semantic segmentation methods[J]. Measurement, 2022, 188: 110569.

[13] GOLODOV V A, MALOSTEVA A A. Approach to weld segmentation and defect classification in radiographic images of pipe welds[J]. NDT & E International, 2022, 127: 102597.

[14] CHANG Y, CHANG D J. Research on solder joint defect recognition algorithm based on improved convolutional neural network[J]. Laser Technology,2020,44(6):779-783.

[15] RONNEBERGER O, FISCHER P, BROX T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Munich, Germany: Springer, 2015: 234-241.

[16] WU L, FU D Ch, CHENG Ch. Multi-attention brain tumor image segmentation algorithm based on Unet[J]. Computer Technology and Development, 2021,31(12):85-91(in Chinese).

[17] SCHLEMPER J, OKTAY O, SCHAAP M, et al. Attention gated networks: Learning to leverage salient regions in medical images[J]. Medical Image Analysis, 2019, 53: 197-207.

[18] LI D L, WAN J, ZHU H F, et al. Underwater image recognition technology research based on HSV color space[J]. Scientia Sinca Physica, Mechanica & Astronomica,2015,45(8):71-75(in Chin-ese).

[19] ZHONG H, WANG R. A visual-degradation-inspired model with HSV color-encoding for contour detection[J]. Journal of Neuroscience Methods, 2021,369: 109423.

[20] CHERNOV V, ALANDER J, BOCHKO V. Integer-based accurate conversion between RGB and HSV color spaces[J]. Computers & Electrical Engineering, 2015, 46: 328-337.

[21] ZHANG Q, LI J F, ZHUO L. Vehicle color recognition using convolutional neural network for urban surveillance images[J]. Measurement and Control Technology,2017,36(10):11-14(in Chinese).

[22] ZHOU X, LIU Sh D, PAN W, et al. Vehicle color recognition in natural traffic scene[J]. Computer Science,2021,48(s1):15-20(in Chinese).

[23] BARGSHADY G, ZHOU X, DEO R C, et al. The modeling of human facial pain intensity based on Temporal Convolutional Networks trained with video frames in HSV color space[J]. Applied Soft Computing, 2020, 97: 106805.

[24] SHELHAMER E, LONG J, DARRELL T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4): 640-651.

[25] CHEN L Ch, PAPANDREOU G, KOKKINOS I, et al. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018,40(4): 834-848.

吴家洲, 刘君, 施佳文, 张胜. 激光焊缝图像分割与颜色识别方法研究[J]. 激光技术, 2023, 47(5): 723. WU Jiazhou, LIU Jun, SHI Jiawen, ZHANG Sheng. Research on image segmentation and color recognition method of laser weld[J]. Laser Technology, 2023, 47(5): 723.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!