Molten pool contour extraction method based on edge oriented operator template matching

ZHANG Chuhao; ZHAO Zhuang; LU Jun; BAI Lianfa; HAN Jing

doi:10.12073/j.hjxb.20210628001

TRANSACTIONS OF THE CHINA WELDING INSTITUTION > 2022 > 43(2): 67-74. > DOI: 10.12073/j.hjxb.20210628001

ZHANG Chuhao, ZHAO Zhuang, LU Jun, BAI Lianfa, HAN Jing. Molten pool contour extraction method based on edge oriented operator template matching[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2022, 43(2): 67-74. DOI: 10.12073/j.hjxb.20210628001

Citation:

PDF (1679 KB)

Molten pool contour extraction method based on edge oriented operator template matching

Nanjing University of Science and Technology, Nanjing, 210094, China

More Information

Received Date: June 27, 2021
Available Online: January 23, 2022

Graphical Abstract

Abstract

Abstract

As the basic visual morphological feature of molten pool, contour extraction plays an important role in on-line monitoring of welding quality. A molten pool visual sensing system under the environment of tungsten inert gas welding (TIG) welding process is established, and high-quality molten pool images are collected. Aiming at the difficulty of weak edge detection in TIG welding stainless steel molten pool image, a molten pool contour extraction algorithm based on operator template matching based on edge direction guidance (OTM-EDG) is proposed. Firstly, the algorithm enhances the weak edge based on the nonlinear gray transformation method. Then, the Sobel operator in four directions is used to convolute with the molten pool image to judge the direction of the back-end weak edge and calculate the gradient map. Finally, the edge connection operation and edge smoothing operation based on mathematical morphology are carried out on the gradient map to obtain the molten pool contour to be extracted. Experiments show that the algorithm can extract the closed, complete and accurate molten pool contour of TIG welding stainless steel. It has high robustness in the actual welding environment, and effectively solves the problem that the weak edge of the molten pool area is difficult to accurately detect.
- molten pool profile,
- nonlinear gray transformation,
- edge oriented operator

FullText(HTML)

References (13)

References

潘龙威, 董红刚. 焊接增材制造研究新进展[J]. 焊接, 2016(4): 27 − 32. doi: 10.3969/j.issn.1001-1382.2016.04.007

Pan Longwei, Dong Honggang. New progress in welding additive manufacturing[J]. Welding & Joining, 2016(4): 27 − 32. doi: 10.3969/j.issn.1001-1382.2016.04.007

宫建锋, 李慧知, 李俐群, 等. 基于同轴图像传感的激光焊接过程质量监测技术[J]. 焊接学报, 2019, 40(1): 37 − 42.

Gong Jianfeng, Li Huizhi, Li Liqun, et al. Quality monitoring technology of laser welding process based on coaxial image sensing[J]. Transactions of the China Welding Institution, 2019, 40(1): 37 − 42.

郭枭, 何鹏, 徐锴, 等. 一种核电用镍基合金焊丝熔敷金属的组织与性能[J]. 焊接学报, 2020, 41(4): 26 − 30.

Guo Xiao, He Peng, Xu Kai, et al. Microstructure and mechanical properties of deposited metal for nuclear plant nickel alloy welding wire[J]. Transactions of the China Welding Institution, 2020, 41(4): 26 − 30.

郑睿. 基于计算机视觉的激光焊接在线监测系统设计[D]. 武汉: 华中科技大学, 2014.

Zheng Rui. On-line laser welding monitoring system design based on computer vision methods[D]. Wuhan: Huazhong University of Science & Technology, 2014.

Yong Z, Jiang L, Yunhua L I, et al. Welding deviation detection agorithm based on extremum of molten pool image contour[J]. Chinese Journal of Mechanical Engineering, 2016, 29(1): 74 − 83. doi: 10.3901/CJME.2015.0908.110

刘晓刚, 闫红方, 张荣. 基于形态学多尺度多结构的熔池图像边缘检测[J]. 热加工工艺, 2019, 48(5): 216 − 219.

Liu Xiaogang, Yan Hongfang, Zhang Rong. Edge detection of molten pol image based on morphology multi-scale and multi-structuring elements[J]. Hot Working Technolog, 2019, 48(5): 216 − 219.

于海川, 穆平安. 自适应Canny算法在钢板缺陷边缘检测中的应用[J]. 软件导刊, 2018, 17(4): 175 − 177.

Yu Haichuan, Mu Ping'an. Application of adaptive Canny algorithm in edge detection of steel plate defects[J]. Software, 2018, 17(4): 175 − 177.

张亚红, 覃科. 一种形态学与Canny算子融合的焊接熔池边缘检测算法[J]. 桂林航天工业学院学报, 2017, 22(1): 9 − 13. doi: 10.3969/j.issn.1009-1033.2017.01.003

Zhang Yahong, Qin Ke. A welding pool edge detection algorithm based on morphology and Canny operator fusion[J]. Journal of Guilin University of Aerospace Technology, 2017, 22(1): 9 − 13. doi: 10.3969/j.issn.1009-1033.2017.01.003

Zhang Yuwei, Zhao Zhuang, Zhang Yi, et al. Online weld pool contour extraction and seam width prediction based on mixing spectral vision[J]. Optical Review, 2019, 26(1): 65 − 76. doi: 10.1007/s10043-018-0479-3

Xia Chunyang, Pan Zengxi, Zhang Shiyu, et al. Model predictive control of layer width in wire arc additive manufacturing[J]. Journal of Manufacturing Processes, 2020, 58: 179 − 186. doi: 10.1016/j.jmapro.2020.07.060

韩庆璘, 李大用, 李鑫磊, 等. 基于分区减光的电弧增材制造熔敷道尺寸主被动联合视觉检测[J]. 焊接学报, 2020, 41(9): 28 − 32. doi: 10.12073/j.hjxb.20200418001

Han Qinglin, Li Dayong, Li Xinlei, et al. Bead geometry measurement for wire and arc additive manufacturing using active-passive composite vision sensing based on regional filter[J]. Transactions of the China Welding Institution, 2020, 41(9): 28 − 32. doi: 10.12073/j.hjxb.20200418001

蔡敏. 铝合金GTAW熔池区视觉特征检测及焊缝成型控制[D]. 上海: 上海交通大学, 2013.

Cai Min. Visual characters extraction of weld pool and shape control during aluminum alloy GTAW process[D]. Shanghai : Shanghai Jiao Tong University, 2013.

李钦弟, 蔡利栋. 一种基于非线性灰度变换的弱边缘检测方法[J]. 中国体视学与图像分析, 2011, 16(3): 232 − 236.

Li Qindi, Cai Lidong. A weak edge detection method based on nonlinear transform of gray levels[J]. Chinese Journal of Stereology and Image Analysis, 2011, 16(3): 232 − 236.

[1]	ZHOU Xin, HUANG Ruisheng, LIANG Xiaomei, TENG Bin. Analysis of in-situ heat treatment on microstructure and mechanical properties by quadruple-electrode gas tungsten arc additive manufacturing of 00Cr13Ni5Mo stainless steel[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION. DOI: 10.12073/j.hjxb.20240202001
[2]	ZHENG Wenjian, LI Zhengyang, WANG Xinghua, GONG Xuhui, YAN Dejun, LAI Shaobo, YANG Jianguo. Effect of heat conduction mode on microstructure and properties of 800 MPa class marine high strength steel fabricated by wire arc additive manufacturing[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(5): 38-46. DOI: 10.12073/j.hjxb.20230605004
[3]	XU Junqiang, PENG Yong, LIU Zhihui, ZHOU Qi, KONG Jian. Study on plasma arc additive manufacturing process of dissimilar steels with various composite structures[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(11): 119-124. DOI: 10.12073/j.hjxb.2019400298
[4]	HE Jie, FENG Yuehai, ZHANG Lin, ZHAN Bin. Research on microstructure and mechanical properties of high strength Al-Mg alloy fabricated by double-wire and gas tungsten arc additive manufacturing process[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(7): 109-113. DOI: 10.12073/j.hjxb.2019400191
[5]	ZHAN Bin, FENG Yuehai, HE Jie, LIU Siyu. Research on fabrication and microstructure between carbon steel double wire and single wire plasma arc additive manufacturing[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(6): 77-81. DOI: 10.12073/j.hjxb.2019400158
[6]	QIU Ranfeng1,2, LI Qingzhe1, SHI Hongxin1,2, SATONAKA Shinobu3. Resistance spot welding of titanium and mild steel[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2018, 39(4): 45-48. DOI: 10.12073/j.hjxb.2018390093
[7]	WANG Peng, XIE Pu, ZHAO Haiyan, GUAN Qiao. Fundamental research of welding plastic strain evolution process:Characteristics and law of evolution process of welding plastic strain in mild steel,stainless steel and titanium alloy thin plate[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2013, (12): 63-66.
[8]	ZHANG Huajun, ZHANG Guangjun, WANG Junheng, WU Lin. Effect of thermal cycles of DSAW on microstructure in low alloy high strength steel[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2007, (10): 81-84.
[9]	ZHANG Rui hua, FAN Ding, YU Shu rong. Study activating flux for mild steel[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2003, (2): 16-18.
[10]	Li Wushen, Chang Yiquan, Zhang Bingfan. SMAW expert system for mild and alloyed structural steels[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 1994, (3): 197-202.

Cited By

Cited by

Periodical cited type(2)

1.	樊炳倩，沈闲. 激光选区熔化参数对热物理过程影响数学模型分析. 激光杂志. 2025(01): 222-227 .
2.	袁健，何斌，张俊飞，陈国炎，张锁荣. 纳秒激光参数对316L不锈钢沟槽结构加工的影响. 金属加工(热加工). 2024(05): 61-66 .

Other cited types(2)

Get Citation

PDF

XML

Article views (464) PDF downloads (65) Cited by(4)

Turn off MathJax

Article Contents

Abstract

References

Molten pool contour extraction method based on edge oriented operator template matching