Citation: | LIANG Zhimin, GAO Xu, REN Zheng, WU Ziqin, WANG Liwei, WANG Dianlong. Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(2): 61-66. DOI: 10.12073/j.hjxb.20230224001 |
In order to realize the complete three-dimensional sensing of weld pool surface morphology, a stereo vision sensing system with biprism and single camera was constructed. Aiming at the difficulty of stereo matching caused by the lack of texture in weld pool map, a globally optimized variational stereo matching algorithm was introduced. By establishing the feasibility function of energy function containing gray difference data item and spatial continuity constraint item, the dense disparity figure of weld pool surface with rich details was obtained through iterative. The results of stereo matching and three-dimensional reconstruction of the self-made non-standard concave shape show that the width error is less than 3.16% and the depth error is less than 4.82%. Based on this algorithm, the dense disparity map of weld pool surface is calculated and reconstructed under the conditions of bead on plate and V-groove butt welding with different penetration states.
[1] |
Zhang Y M, Yang Y P, Zhang W, et al. Advanced welding manufacturing: A brief analysis and review of challenges and solutions: Transactions of the ASME[J]. Journal of Manufacturing Science and Engineering, 2020, 142(11): 110816. doi: 10.1115/1.4047947
|
[2] |
夏卫生, 龚福建, 杨荣国, 等. 基于红外视觉的熔化极气体保护焊外观缺陷识别[J]. 焊接学报, 2020, 41(3): 69 − 73.
Xia Weisheng, Gong Fujian, Yang Rongguo, et al. Apparent defect recognition of gas metal arc welding based on infrared vision[J]. Transactions of the China Welding Institution, 2020, 41(3): 69 − 73.
|
[3] |
Jiao W H, Wang Q Y, Cheng Y C, et al. End-to-end prediction of weld penetration: A deep learning and transfer learning based method[J]. Journal of Manufacturing Processes, 2021, 63(3): 191 − 197.
|
[4] |
Nomura K, Fukushima K, Matsumura T, et al. Burn-through prediction and weld depth estimation by deep learning model monitoring the molten pool in gas metal arc welding with gap fluctuation[J]. Journal of Manufacturing Processes, 2021, 61(1): 590 − 600.
|
[5] |
Song H S, Zhang Y M. Measurement and analysis of three-dimensional specular gas tungsten arc weld pool surface[J]. Welding Journal, 2008, 87(4): 85 − 95.
|
[6] |
Zhang W J, Liu Y K, Zhang Y M. Real-time measurement of the weld pool surface in GTAW process[C]//2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), May 6-9 2013, Minneapolis, MN, USA : IEEE, 2013: 1640-1645.
|
[7] |
Huang J K, He J, He X Y, et al. Study on dynamic development of three-dimensional weld pool surface in stationary GTAW[J]. High Temperature Materials and Processes, 2018, 37(5): 455 − 462. doi: 10.1515/htmp-2016-0224
|
[8] |
Mnich C, Al-Bayat F, Debrunner C, et al. In situ weld pool measurement using stereovision[C]//2004 Japan-USA Symposium on Flexible Automation, ASME-DSC, 2004: 19-21.
|
[9] |
Neill A M, Steele J P H. Modeling and simulation of three dimensional weld pool reconstruction by stereo vision[C]//2016 IEEE international conference on advanced intelligent mechatronics (AIM). 12-15 July 2016 , Banff, AB, Canada: IEEE, 2016: 542-547.
|
[10] |
Zhao C X, Richardson I M, Kenjeres S, et al. A stereo vision method for tracking particle flow on the weld pool surface[J]. Journal of Applied Physics, 2009, 105(12): 123104. doi: 10.1063/1.3143789
|
[11] |
Zhang Y D, Liang Z M, Wang D L, et al. 3D reconstruction of weld pool surface by a biprism stereo system[J]. Applied Mechanics and Materials, 2012, 236: 469 − 473.
|
[12] |
尹紫秋, 熊俊. 基于ACT匹配的GMA增材制造熔池形貌三维重建[J]. 焊接学报, 2019, 40(1): 49 − 52.
Yin Ziqiu, Xiong Jun. Three-dimensional reconstruction of molten pool appearance in GMA additive manufacturing based on ACT stereo matching algorithm[J]. Transactions of the China Welding Institution, 2019, 40(1): 49 − 52.
|
[13] |
Gu Z A, Chen J, Wu C S. Three-dimensional reconstruction of welding pool surface by binocular vision[J]. Chinese Journal of Mechanical Engineering, 2021, 34(1): 1 − 13. doi: 10.1186/s10033-020-00524-5
|
[14] |
Liang Z M, Chang H X, Wang Q Y, et al. 3D reconstruction of weld pool surface in pulsed GMAW by passive biprism stereo vision[J]. IEEE Robotics and Automation Letters, 2019, 4(3): 3091 − 3097. doi: 10.1109/LRA.2019.2924844
|
[15] |
Pock T, Schoenemann T, Graber G, et al. A convex formulation of continuous multi-label problems[C]//Computer Vision–ECCV 2008: 10th European Conference on Computer Vision, Marseille, France, October 12-18, 2008, Heidelberg, Berlin: Springer, 2008: 792-805.
|