Advanced Search
WANG Hao, ZHAO Xiaohui, XU Longzhe, JIANG Hao, LIU Yu. Research on trajectory recognition and control technology of structured light vision-assisted welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2023, 44(6): 50-57. DOI: 10.12073/j.hjxb.20220715002
Citation: WANG Hao, ZHAO Xiaohui, XU Longzhe, JIANG Hao, LIU Yu. Research on trajectory recognition and control technology of structured light vision-assisted welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2023, 44(6): 50-57. DOI: 10.12073/j.hjxb.20220715002

Research on trajectory recognition and control technology of structured light vision-assisted welding

More Information
  • Received Date: July 14, 2022
  • Available Online: May 14, 2023
  • Three trajectory recognition and control techniques for laser multi-point positioning, pre-welding trajectory fitting, and seam real-time tracking for structured light vision-assisted welding are investigated. A CNN model, adaptive feature extraction algorithm, a priori model, and coordinate matrix conversion are proposed as the core of the welding trajectory recognition process for these three. Welding trajectory control models are proposed for each of the above three, which including a taught trajectory correction model, a pre-welding trajectory fitting model, and a real-time deflection correction model for seam tracking. The experiments prove that laser multi-point positioning, pre-welding trajectory fitting model can efficiently identify the weld trajectory curve before welding, and the welding trajectory basically coincides with the centerline of the seam; when welding in the real-time seam tracking model, the real-time deviation is mainly controlled within ± 0.2 mm, with an average deviation of 0.1160 mm. The results show that the welding trajectory identification process and trajectory control model mentioned in this paper are sufficient to ensure stable operation of structured light vision-assisted welding.
  • Zou Y, Li J, Chen X. Seam tracking investigation via striped line laser sensor[J]. Industrial Robot:An International Journal, 2017, 44(5): 609 − 617. doi: 10.1108/IR-11-2016-0294
    Zou Y, Chen X, Gong G, et al. A seam tracking system based on a laser vision sensor[J]. Measurement, 2018, 127: 489 − 500. doi: 10.1016/j.measurement.2018.06.020
    Zou Y, Zhu M, Chen X. A Robust Detector for Automated Welding Seam Tracking System[J]. Journal of Dynamic Systems, Measurement, and Control, 2021, 143(7): 071001. doi: 10.1115/1.4049547
    Zou Y, Wang Y, Zhou W, et al. Real-time seam tracking control system based on line laser visions[J]. Optics & Laser Technology, 2018, 103: 182 − 192.
    Zou Y, Chen J, Wei X. Research on a real-time pose estimation method for a seam tracking system[J]. Optics and Lasers in Engineering, 2020, 127: 105947. doi: 10.1016/j.optlaseng.2019.105947
    Zhao Z, Luo J, Wang Y, et al. Additive seam tracking technology based on laser vision[J]. The International Journal of Advanced Manufacturing Technology, 2021, 116(1): 197 − 211.
    Xiao R, Xu Y, Hou Z, et al. An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding[J]. Sensors and Actuators A:Physical, 2019, 297: 111533. doi: 10.1016/j.sna.2019.111533
    Zhang G, Yun T-J, Oh W-B, et al. A study on seam tracking in robotic GMA welding process[J]. Materials Today:Proceedings, 2020, 22: 1771 − 1777. doi: 10.1016/j.matpr.2020.03.010
    Xue B, Chang B, Peng G, et al. A Vision Based Detection Method for Narrow Butt Joints and a Robotic Seam Tracking System[J]. Sensors, 2019, 19(5): 1144. doi: 10.3390/s19051144
    Wu Q Q, Lee J P, Park M H, et al. A study on the modified Hough algorithm for image processing in weld seam tracking[J]. Journal of Mechanical Science and Technology, 2015, 29(11): 4859 − 4865. doi: 10.1007/s12206-015-1033-x
    Muhammad J, Altun H, Abo-Serie E. A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision[J]. The International Journal of Advanced Manufacturing Technology, 2018, 94(1): 13 − 29.
    Fan J, Jing F, Yang L, et al. A precise seam tracking method for narrow butt seams based on structured light vision sensor[J]. Optics & Laser Technology, 2019, 109: 616 − 626.
  • Related Articles

    [1]LE Jian, LI Fayuan, SHU Zhiheng, ZENG Mingru, ZHANG Hua. Welding current and voltage detection and control method based on visual sensing[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(11): 85-89. DOI: 10.12073/j.hjxb.20240705002
    [2]ZHU Qidan, WANG Yanke, ZHU Wei, LIU Yue. Intelligent recognition algorithm of welding point based on structured light[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(7): 82-87,99. DOI: 10.12073/j.hjxb.2019400186
    [3]LI Lin, LI Chun, ZOU Yanbiao. Welding path search algorithm based on machine vision[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2015, 36(6): 57-60.
    [4]GONG Yefei, LI Xinde, DAI Xianzhong, CHENG Xianggen. A weld robot off-line programming system integrated with virtual structured-light sensor[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2011, (4): 17-20.
    [5]GONG Yefei, DAI Xianzhong, LI Xinde. Robust joint recognition with structured-light vision sensing[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2009, (9): 85-88.
    [6]JIAO Xiang-dong, HUANG Song-tao, ZHOU Can-feng, XUE Long, FANG Xiao-ming, ZHANG Yi-sheng. Route recognition algorithm in hyperbaric subsea pipe welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2007, (1): 1-4.
    [7]LIU Li-jun, ZHAN Xiao-hong, HAN Yu-jie, LI Dong-qing, WU Lin. Multi-freedom controlling of dynamic moving track of tungsten electrode in narrow-gap all-position welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2004, (5): 17-21.
    [8]XU De, TU Zhi-guo, ZHAO Xiao-guang, TAN Min. Study on arc welding robot visual control[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2004, (4): 10-14.
    [9]WANG Jian-jun, LIN Tao, CHEN Shan-ben, HU Jun-chuan. Adaptive control based on vision technology for aluminium alloy TIG welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2003, (4): 17-20,24.
    [10]Li Yan, Shao Junbao, Wu Lin, Lin Tao. A method of robotic welding seam tracking with 3D vision information[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 1993, (2): 132-136.
  • Cited by

    Periodical cited type(1)

    1. 谭锦红,张新平,曹姗姗,王鹏,曾庆瑞,陈斌. U71Mn钢闪光-摩擦复合焊接头组织性能. 焊接学报. 2024(09): 62-68 . 本站查看

    Other cited types(0)

Catalog

    Article views (356) PDF downloads (103) Cited by(1)

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return