Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm

LIANG Zhimin; GAO Xu; REN Zheng; WU Ziqin; WANG Liwei; WANG Dianlong

doi:10.12073/j.hjxb.20230224001

TRANSACTIONS OF THE CHINA WELDING INSTITUTION > 2024 > 45(2): 61-66. > DOI: 10.12073/j.hjxb.20230224001

LIANG Zhimin, GAO Xu, REN Zheng, WU Ziqin, WANG Liwei, WANG Dianlong. Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(2): 61-66. DOI: 10.12073/j.hjxb.20230224001

Citation:

PDF (1516 KB)

Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm

LIANG Zhimin^{1, 2,},
GAO Xu¹,
REN Zheng¹,
WU Ziqin¹,
WANG Liwei^{1, 2},
WANG Dianlong^{1, 2}

1.
School of Material Science and Engineering, University of Science and Technology, Shijiazhuang, 050000, China
2.
Hebei Key Laboratory of Material Near-net Forming Technology, Shijiazhuang, 050000, China

More Information

Received Date: February 03, 2023
Available Online: December 03, 2023

Graphical Abstract

Abstract

Abstract

In order to realize the complete three-dimensional sensing of weld pool surface morphology, a stereo vision sensing system with biprism and single camera was constructed. Aiming at the difficulty of stereo matching caused by the lack of texture in weld pool map, a globally optimized variational stereo matching algorithm was introduced. By establishing the feasibility function of energy function containing gray difference data item and spatial continuity constraint item, the dense disparity figure of weld pool surface with rich details was obtained through iterative. The results of stereo matching and three-dimensional reconstruction of the self-made non-standard concave shape show that the width error is less than 3.16% and the depth error is less than 4.82%. Based on this algorithm, the dense disparity map of weld pool surface is calculated and reconstructed under the conditions of bead on plate and V-groove butt welding with different penetration states.
- weld pool appearance,
- three-dimensional reconstruction,
- variational stereo matching algorithm,
- gas metal arc welding

FullText(HTML)

References (15)

References

[1]	Zhang Y M, Yang Y P, Zhang W, et al. Advanced welding manufacturing: A brief analysis and review of challenges and solutions: Transactions of the ASME[J]. Journal of Manufacturing Science and Engineering, 2020, 142(11): 110816. doi: 10.1115/1.4047947
[2]	夏卫生, 龚福建, 杨荣国, 等. 基于红外视觉的熔化极气体保护焊外观缺陷识别[J]. 焊接学报, 2020, 41(3): 69 − 73. Xia Weisheng, Gong Fujian, Yang Rongguo, et al. Apparent defect recognition of gas metal arc welding based on infrared vision[J]. Transactions of the China Welding Institution, 2020, 41(3): 69 − 73.
[3]	Jiao W H, Wang Q Y, Cheng Y C, et al. End-to-end prediction of weld penetration: A deep learning and transfer learning based method[J]. Journal of Manufacturing Processes, 2021, 63(3): 191 − 197.
[4]	Nomura K, Fukushima K, Matsumura T, et al. Burn-through prediction and weld depth estimation by deep learning model monitoring the molten pool in gas metal arc welding with gap fluctuation[J]. Journal of Manufacturing Processes, 2021, 61(1): 590 − 600.
[5]	Song H S, Zhang Y M. Measurement and analysis of three-dimensional specular gas tungsten arc weld pool surface[J]. Welding Journal, 2008, 87(4): 85 − 95.
[6]	Zhang W J, Liu Y K, Zhang Y M. Real-time measurement of the weld pool surface in GTAW process[C]//2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), May 6-9 2013, Minneapolis, MN, USA : IEEE, 2013: 1640-1645.
[7]	Huang J K, He J, He X Y, et al. Study on dynamic development of three-dimensional weld pool surface in stationary GTAW[J]. High Temperature Materials and Processes, 2018, 37(5): 455 − 462. doi: 10.1515/htmp-2016-0224
[8]	Mnich C, Al-Bayat F, Debrunner C, et al. In situ weld pool measurement using stereovision[C]//2004 Japan-USA Symposium on Flexible Automation, ASME-DSC, 2004: 19-21.
[9]	Neill A M, Steele J P H. Modeling and simulation of three dimensional weld pool reconstruction by stereo vision[C]//2016 IEEE international conference on advanced intelligent mechatronics (AIM). 12-15 July 2016 , Banff, AB, Canada: IEEE, 2016: 542-547.
[10]	Zhao C X, Richardson I M, Kenjeres S, et al. A stereo vision method for tracking particle flow on the weld pool surface[J]. Journal of Applied Physics, 2009, 105(12): 123104. doi: 10.1063/1.3143789
[11]	Zhang Y D, Liang Z M, Wang D L, et al. 3D reconstruction of weld pool surface by a biprism stereo system[J]. Applied Mechanics and Materials, 2012, 236: 469 − 473.
[12]	尹紫秋, 熊俊. 基于ACT匹配的GMA增材制造熔池形貌三维重建[J]. 焊接学报, 2019, 40(1): 49 − 52. Yin Ziqiu, Xiong Jun. Three-dimensional reconstruction of molten pool appearance in GMA additive manufacturing based on ACT stereo matching algorithm[J]. Transactions of the China Welding Institution, 2019, 40(1): 49 − 52.
[13]	Gu Z A, Chen J, Wu C S. Three-dimensional reconstruction of welding pool surface by binocular vision[J]. Chinese Journal of Mechanical Engineering, 2021, 34(1): 1 − 13. doi: 10.1186/s10033-020-00524-5
[14]	Liang Z M, Chang H X, Wang Q Y, et al. 3D reconstruction of weld pool surface in pulsed GMAW by passive biprism stereo vision[J]. IEEE Robotics and Automation Letters, 2019, 4(3): 3091 − 3097. doi: 10.1109/LRA.2019.2924844
[15]	Pock T, Schoenemann T, Graber G, et al. A convex formulation of continuous multi-label problems[C]//Computer Vision–ECCV 2008: 10th European Conference on Computer Vision, Marseille, France, October 12-18, 2008, Heidelberg, Berlin: Springer, 2008: 792-805.

[1]	LI Xiao, DU Yahong, GAO Liyin, YUAN Xiaohong, ZHOU Wenyan, KANG Feifei, LIU Zhiquan. Influence of plasma cleaning on the surface state and mechanical properties of Cu/Al wire bonding joint[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(12): 14-19. DOI: 10.12073/j.hjxb.20231020002
[2]	GUAN Ruofei, JIA Qiang, ZHAO Jin, ZHANG Hongqiang, WANG Yishu, ZOU Guisheng, GUO Fu. Research progress in high-performance power device packaging and power cycle reliability[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2023, 44(12): 124-136. DOI: 10.12073/j.hjxb.20230613015
[3]	CHI Dazhao, GUO Tao, ZHANG Runqi, ZHANG Tao, SHEN Hao. Study on real-time imaging detection of bonding defects by acoustic impedance method[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2022, 43(11): 107-111. DOI: 10.12073/j.hjxb.20220702001
[4]	XU Yan, LIU Yinglai, NIE Xianghui, FENG Zhenjun, LI Liang, YANG Fengping. Analysis of mechanical properties and application effect of over-matching lap angle weld joint[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2022, 43(10): 101-105. DOI: 10.12073/j.hjxb.20211021001
[5]	HE Xiaodong, GAO Xiongxiong, David Han, CHI Qiang, HUO Chunyong, José B. Bacalhau. Performance and strain evolution of different strength matching girth welds of high Nb X80 pipeline[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2022, 43(2): 34-39. DOI: 10.12073/j.hjxb.20210330004
[6]	QIN Guoliang, FENG Chao, JIANG Haihong, JIANG Zili, GENG Peihao. Microstructure and properties of weld by high-speed tandem TIG welding of different arc power matching[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(11): 39-44. DOI: 10.12073/j.hjxb.2019400285
[7]	NIU Yong, SONG Yonglun, ZENG Zhoumo. Resonance phenomenon of small current pulsed TIG arc and analysis of AC impedance features[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2011, (2): 13-16.
[8]	YANG Yunzhen, WANG Guilan, ZHANG Haiou, XIA Weisheng. Preparation and complex impedance analysis of functionally gradient PEN for MOLB-type SOFC by plasma spraying digital forming[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2008, (1): 13-16.
[9]	CAO Lei, SUN Qian, ZONG Pei, FAN Ming-qi. Characteristis and sorting method of equal strength matched welded joint[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2006, (7): 81-84.
[10]	LI Jie, ZHANG Yu-feng, HUO Li-xing, WANG Dong-po. Effect of strength match on damage performance of welded connection under the seismic loading[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2003, (1): 27-30.

Cited By

Cited by

Periodical cited type(2)

1.	曹润平，韩永全，刘晓虎，洪海涛，韩蛟. 稀土铈对电弧及熔滴过渡行为的影响. 焊接学报. 2025(01): 95-102 . 本站查看
2.	刘景武，张蕾，杜义，孙磊，王杏华，张晓，董星. 785 MPa及以上高强钢焊接材料的研发现状与展望. 精密成形工程. 2025(02): 62-75 .

Other cited types(0)

Get Citation

PDF

XML

Article views (150) PDF downloads (43) Cited by(2)

Turn off MathJax

Article Contents

Abstract

References

Three-dimensional reconstruction of GMAW weld pool appearance based on variational stereo matching algorithm