| Citation: |
ZHOU Hao, CHEN Shanben. A MLMP welding pool classification model for medium-thick low-carbon steel plates based on a VGGNet with a visual attention mechanism[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(11): 71-76. DOI: 10.12073/j.hjxb.20240710001
|
The multi-layer and multi-pass welding (MLMPW) of medium-thick plates in large equipment manufacturing has always been a challenging and important research topic. The core of achieving robotic MLMPW lies in acquiring, monitoring, and classifying the weld pool. To enhance the automation and intelligence of MLMPW, it is necessary to develop an online classification system for weld pool images. A novel MLMPW weld pool classification method is proposed for weld pool images during the welding process, utilizing a VGGNet with a visual attention mechanism (SENet). To improve efficiency and accuracy, pre-trained models from transfer learning are introduced into the network training process. Due to the lack of research on the medium-thick plate multi-layer and multi-pass molten pool, there are few open datasets of molten pool. In order to deal with this problem, data augmentation is necessary to applied to the dataset. The results indicate that the proposed model can quickly and effectively classify seven types of MLMPW weld pools with an accuracy of 98.39%.
| [1] |
Zhang H, Lu H, Cai C, et al. Robot path planning in multi-pass weaving welding for thick plates [C]//Robotic Welding, Intelligence and Automation: RWIA’2010. Berlin, Heidelberg: Springer Berlin Heidelberg, 2011: 351 − 359.
|
| [2] |
Xue K, Wang Z, Shen J, et al. Robotic seam tracking system based on vision sensing and human-machine interaction for multi-pass MAG welding[J]. Journal of Manufacturing Processes, 2021, 63: 48 − 59. doi: 10.1016/j.jmapro.2020.02.026
|
| [3] |
Yang C, Zhong J, Chen Y, et al. The realization of no back chipping for thick plate welding[J]. The International Journal of Advanced Manufacturing Technology, 2014, 74: 79 − 88. doi: 10.1007/s00170-014-5927-z
|
| [4] |
徐东辉, 孟范鹏, 孙鹏, 等. 基于深度学习的 GMAW 焊接缺陷在线监测[J]. 焊接学报, 2024, 45(3): 114 − 119.
Xu D, Meng F, Sun P, et al. Online monitoring of GMAW welding defect based on deep learning[J]. Transactions of the China Welding Institution, 2024, 45(3): 114 − 119.
|
| [5] |
高昶霖, 宋燕利, 左洪洲, 等. 基于动态权重的自适应 PSO-BP 神经网络焊接缺陷成因诊断[J]. 焊接学报, 2022, 43(1): 98 − 106.
Gao C, Song Y, Zuo H, et al. Cause diagnosis of welding defects based on adaptive PSO-BP neural network with dynamic weighting[J]. Transactions of The China Welding Institution, 2022, 43(1): 98 − 106.
|
| [6] |
Zhou H, He Y, Chen H, et al. MLD classification model of visual features of multi-layer and multi-pass molten pool during robotic MAG welding of medium-thick steel plates[C]//International Conference on Robotic Welding, Intelligence and Automation. Singapore: Springer Nature Singapore, 2020: 56 − 81.
|
| [7] |
Hu J, Shen L, Sun G. Squeeze-and-excitation networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, 2018: 7132 − 7141.
|
| [8] |
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition [J]. arXiv preprint arXiv: 14091556, 2014.
|
| [1] | WU Gang, CHEN Tian, YU Lianghui, LIU Zhipeng. Study on classification of tensile shear strength of spot welding joints based on PSO-SVM[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(9): 120-128. DOI: 10.12073/j.hjxb.20230820001 |
| [2] | WU Gang, CHEN Tian, YU LiangHui, LIU Zhipeng. Research on automatic classification of spot welding joint strength based on PSO-SVM[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION. DOI: 10.12073/j.hjxb.20220829001 |
| [3] | HU Hongwei, ZHANG Jie, PENG Gang, YI Kefu, WANG Lei. Defect classification for ultrasonic inspection in weld seam based on LBP-KPCA feature extraction[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(6): 34-39. DOI: 10.12073/j.hjxb.2019400151 |
| [4] | LI Hexi, HAN Xinle, FANG Zaojun. A visual model of welding robot based on CNN deep learning[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(2): 154-160. DOI: 10.12073/j.hjxb.2019400060 |
| [5] | CHEN Haiyong, REN Yafei, WANG Yanan, CAO Junqi. Clear image acquisition of V-shaped welding area based on visual attention[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2018, 39(9): 19-24,35. DOI: 10.12073/j.hjxb.2018390217 |
| [6] | HE Yinshui, KONG Meng, CHEN Huabin, CHEN Yuxi, CHEN Shanben. Weld seam profile identification based on visual attention mechanism in robotic thick-plate welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2015, 36(12): 51-55. |
| [7] | ZHANG Yan, LÜ Na, HUANG Yiming, CHEN Shanben. Feature characters extraction with visual attention method based on three-light-path weld pool images[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2014, 35(8): 53-56. |
| [8] | LUO Aimin, SHEN Caihong, YI Bing, LI Kun. Method of multi-classification by improved binary tree based on SVM for welding defects recongnition[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2010, (7): 51-54. |
| [9] | DU Xiuli, SHEN Yi, WANG Yan. Weld defect classification in ultrasonic testing basing on timefrequency discriminant features[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2008, (2): 89-92. |
| [10] | Wang Qilong, Yin Shuyan, Zhang Jiuhai. ABOUT THE CLASSIFICATION AND THE CHINESE DESIGNATION OF THE METAL TRANSFER MODES OF FREE FLIGHT IN MIG WELDING[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 1983, (3): 149-154. |
Supported by:
Beijing Renhe Information Technology Co. Ltd
DownLoad: