Citation: | LIANG Zhimin, GAO Xu, REN Zheng, WU Ziqin, WANG Liwei, WANG Dianlong. Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(2): 61-66. DOI: 10.12073/j.hjxb.20230224001 |
In order to realize the complete three-dimensional sensing of weld pool surface morphology, a stereo vision sensing system with biprism and single camera was constructed. Aiming at the difficulty of stereo matching caused by the lack of texture in weld pool map, a globally optimized variational stereo matching algorithm was introduced. By establishing the feasibility function of energy function containing gray difference data item and spatial continuity constraint item, the dense disparity figure of weld pool surface with rich details was obtained through iterative. The results of stereo matching and three-dimensional reconstruction of the self-made non-standard concave shape show that the width error is less than 3.16% and the depth error is less than 4.82%. Based on this algorithm, the dense disparity map of weld pool surface is calculated and reconstructed under the conditions of bead on plate and V-groove butt welding with different penetration states.
[1] |
Zhang Y M, Yang Y P, Zhang W, et al. Advanced welding manufacturing: A brief analysis and review of challenges and solutions: Transactions of the ASME[J]. Journal of Manufacturing Science and Engineering, 2020, 142(11): 110816. doi: 10.1115/1.4047947
|
[2] |
夏卫生, 龚福建, 杨荣国, 等. 基于红外视觉的熔化极气体保护焊外观缺陷识别[J]. 焊接学报, 2020, 41(3): 69 − 73.
Xia Weisheng, Gong Fujian, Yang Rongguo, et al. Apparent defect recognition of gas metal arc welding based on infrared vision[J]. Transactions of the China Welding Institution, 2020, 41(3): 69 − 73.
|
[3] |
Jiao W H, Wang Q Y, Cheng Y C, et al. End-to-end prediction of weld penetration: A deep learning and transfer learning based method[J]. Journal of Manufacturing Processes, 2021, 63(3): 191 − 197.
|
[4] |
Nomura K, Fukushima K, Matsumura T, et al. Burn-through prediction and weld depth estimation by deep learning model monitoring the molten pool in gas metal arc welding with gap fluctuation[J]. Journal of Manufacturing Processes, 2021, 61(1): 590 − 600.
|
[5] |
Song H S, Zhang Y M. Measurement and analysis of three-dimensional specular gas tungsten arc weld pool surface[J]. Welding Journal, 2008, 87(4): 85 − 95.
|
[6] |
Zhang W J, Liu Y K, Zhang Y M. Real-time measurement of the weld pool surface in GTAW process[C]//2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), May 6-9 2013, Minneapolis, MN, USA : IEEE, 2013: 1640-1645.
|
[7] |
Huang J K, He J, He X Y, et al. Study on dynamic development of three-dimensional weld pool surface in stationary GTAW[J]. High Temperature Materials and Processes, 2018, 37(5): 455 − 462. doi: 10.1515/htmp-2016-0224
|
[8] |
Mnich C, Al-Bayat F, Debrunner C, et al. In situ weld pool measurement using stereovision[C]//2004 Japan-USA Symposium on Flexible Automation, ASME-DSC, 2004: 19-21.
|
[9] |
Neill A M, Steele J P H. Modeling and simulation of three dimensional weld pool reconstruction by stereo vision[C]//2016 IEEE international conference on advanced intelligent mechatronics (AIM). 12-15 July 2016 , Banff, AB, Canada: IEEE, 2016: 542-547.
|
[10] |
Zhao C X, Richardson I M, Kenjeres S, et al. A stereo vision method for tracking particle flow on the weld pool surface[J]. Journal of Applied Physics, 2009, 105(12): 123104. doi: 10.1063/1.3143789
|
[11] |
Zhang Y D, Liang Z M, Wang D L, et al. 3D reconstruction of weld pool surface by a biprism stereo system[J]. Applied Mechanics and Materials, 2012, 236: 469 − 473.
|
[12] |
尹紫秋, 熊俊. 基于ACT匹配的GMA增材制造熔池形貌三维重建[J]. 焊接学报, 2019, 40(1): 49 − 52.
Yin Ziqiu, Xiong Jun. Three-dimensional reconstruction of molten pool appearance in GMA additive manufacturing based on ACT stereo matching algorithm[J]. Transactions of the China Welding Institution, 2019, 40(1): 49 − 52.
|
[13] |
Gu Z A, Chen J, Wu C S. Three-dimensional reconstruction of welding pool surface by binocular vision[J]. Chinese Journal of Mechanical Engineering, 2021, 34(1): 1 − 13. doi: 10.1186/s10033-020-00524-5
|
[14] |
Liang Z M, Chang H X, Wang Q Y, et al. 3D reconstruction of weld pool surface in pulsed GMAW by passive biprism stereo vision[J]. IEEE Robotics and Automation Letters, 2019, 4(3): 3091 − 3097. doi: 10.1109/LRA.2019.2924844
|
[15] |
Pock T, Schoenemann T, Graber G, et al. A convex formulation of continuous multi-label problems[C]//Computer Vision–ECCV 2008: 10th European Conference on Computer Vision, Marseille, France, October 12-18, 2008, Heidelberg, Berlin: Springer, 2008: 792-805.
|
[1] | XIA Weisheng, GONG Fujian, YANG Rongguo, WAN Chaizhi, YANG Yunzhen. Apparent defect recognition of gas metal arc welding based on infrared vision[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2020, 41(3): 69-73. DOI: 10.12073/j.hjxb.20190928001 |
[2] | TONG Jianhua, ZHANG Kun, LIN Song, WANG Weibing. Comparison of fatigue property of 6082 aluminum alloy joint by friction stir welding and metal inert-gas welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2015, 36(7): 105-108. |
[3] | ZHAO Huihuang, WANG Yaonan, SUN Yaqi, WEI Shudi. An improved three-dimensional reconstruction algorithm for microelectronics assembly solder joint[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2014, 35(8): 30-34,42. |
[4] | SHI Yu, WANG Guilong, ZHU Ming, FAN Ding. Effects of different protective gas on bypass metal transfer in consumable double-electrode gas metal arc welding process[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2014, 35(3): 15-18. |
[5] | ZHANG Tao, GUI Weihua, WANG Suiping. Direct model reference adaptive control of gas metal arc welding process[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2010, (4): 25-27. |
[6] | WANG Demin, GAO Jinqiang, WU Chuansong, ZHANG Shiliang. Vision-based detection of weld pool in short-circuit gas metal arc welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2008, (10): 85-88. |
[7] | FENG Yue-hai, LIU Jia, YIN Shu-yan, WANG Ke-hong. Intelligent digital control system for CO2 short circuiting welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2006, (10): 69-72. |
[8] | WANG Hou-xiao, SUN Jun-sheng, WEI Yan-hong, ZHENG Yuan-yuan. Solution and application of energy distribution models based on point heat sources during gas metal arc welding process[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2006, (5): 27-30,34. |
[9] | WANG fang, HOU Wen-kao, HU S Jack. Research on simulation systems of MIG welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2003, (1): 35-39. |
[10] | Liu Gang, Li Junyue, Yang Lijun, et al. Nature of Pulse Waveform of MIG/MAG Welding Arc Spectrum——Reflection of Metal Droplet Transfer[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2000, (1): 34-36. |