Citation: | WANG Rui, GAO Shaoze, LIU Weipeng, WANG Gang. A lightweight and efficient X-ray weld image defect detection method[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(7): 41-49. DOI: 10.12073/j.hjxb.20230630003 |
In response to the high cost, slow speed, and difficulty in deploying deep learning models in weld defect detection, this paper proposes a lightweight and high precision optimized detection model (LHODM) with good performance. Firstly, a new backbone network is built and an ultra lightweight convolutional ULConv is designed as the network foundation convolution to reduce model depth, and Depthwise operation was used to generate more effective redundant feature mappings, reducing the amount of parameters and computation. Secondly, an efficient and lightweight dedicated module ELCC is designed. Under the premise of lightweight response model, the distribution characteristics of weld defects and imaging rules are considered, and the relationship between isolated areas is captured from both horizontal and vertical directions.Combined with the lightweight up-sampling operator CARAFE, the model has a larger receptive field during feature recombination, makes more effective use of ambient information, and makes up for the loss of lightweight accuracy. Finally, in order to improve convergence speed and loss function efficiency, an OS-IoU loss function is designed, taking into account the angle between the expected regression vectors, redefining the penalty term and correlation, and strengthening the attention to distance loss and shape loss. The results showed that the LHODM model achieved detection accuracy and speed of 91.62% and 63.47 frames per second, with a model memory cost of only 3.99 million, effectively solving the problems of high cost and slow speed in weld defect detection work.
[1] |
樊丁, 胡桉得, 黄健康, 等. 基于改进卷积神经网络的管焊缝 X 射线图像缺陷识别方法[J]. 焊接学报, 2020, 41(1): 7 − 11.
Fan Ding, Hu Ande, Hang Jiankang, et al. X-rayimage defect recognition method of pipe weld based on improved convolution alneural network[J]. Transactions of the China Welding Institution, 2020, 41(1): 7 − 11.
|
[2] |
Huang X, Wang P, Zhang S, et al. Structural health monitoring and material safety with multispectral technique: A review[J]. Journal of Safety Science and Resilience, 2022, 3(1): 48 − 60. doi: 10.1016/j.jnlssr.2021.09.004
|
[3] |
徐建军, 石巍. 金属管道对接焊缝超声检测缺陷类型识别研究[J]. 世界有色金属, 2022(5): 226 − 228. doi: 10.3969/j.issn.1002-5065.2022.05.076
Xu jianjun, Shi Wei. Research on identification of defect types in ultrasonic testing of metal pipeline butt welds[J]. World Nonferrous Metals, 2022(5): 226 − 228. doi: 10.3969/j.issn.1002-5065.2022.05.076
|
[4] |
Xu X, Zhang X, Zhang T. Lite-yolov5: A lightweight deep learning detector for on-board ship detection in large-scene sentinel-1 sar images[J]. Remote Sensing, 2022, 14(4): 10 − 18. doi: 10.3390/rs14041018
|
[5] |
Liang H, Seo S. Lightweight deep learning for road environment recognition[J]. Applied Sciences, 2022, 12(6): 31 − 68. doi: 10.3390/app12063168
|
[6] |
Razfar N, True J, Bassiouny R, et al. Weed detection in soybean crops using custom lightweight deep learning models[J]. Journal of Agriculture and Food Research, 2022, 8: 100308. doi: 10.1016/j.jafr.2022.100308
|
[7] |
Liu M, Chen Y, Xie J, et al. LF-YOLO: A lighter and faster yolo for weld defect detection of X-ray image[J]. IEEE Sensors Journal, 2023, 23(7): 7430 − 7439. doi: 10.1109/JSEN.2023.3247006
|
[8] |
Zhu Y, Yang R, He Y, et al. A Lightweight multiscale attention semantic segmentation algorithm for detecting laser welding defects on safety vent of power battery[J]. IEEE Access, 2021, 9: 39245. doi: 10.1109/ACCESS.2021.3064180
|
[9] |
Yang Y, Yang R, Pan L, et al. A lightweight deep learning algorithm for inspection of laser welding defects on safety vent of power battery[J]. Computers in Industry, 2020, 123: 1 − 8.
|
[10] |
Guo K, He C, Yang M, et al. A pavement distresses identification method optimized for YOLOv5s[J]. Scientific Reports, 2022, 12(1): 35 − 42. doi: 10.1038/s41598-022-07527-3
|
[11] |
Cao J, Li Y, Sun M, et al. Do-conv: Depthwise over-parameterized convolutional layer[J]. IEEE, 2006, 20: 3726 − 3736.
|
[12] |
Mazzini D. Guided upsampling network for real-time semantic segmentation[J]. Springer Berlin Heidelbery, 2018(6): 19 − 26.
|
[13] |
Frajka T, Zeger K. Downsampling dependent upsampling of images[J]. Signal Processing: Image Communication, 2004, 19(3): 257 − 265. doi: 10.1016/j.image.2003.10.003
|
[14] |
Kundu S, Mostafa H, Sridhar S N, et al. Attention-based Image Upsampling[D]. New York: Cornell University, 2020.
|
[15] |
Wang Jiaqi, Chen Kai, Xu Rui, et al. Carafe: Content-aware reassembly of features[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, Arxiv. 2019: 3007 − 3016.
|
[16] |
Zhou M, Li B, Wang Jue. Optimization of hyperparameters in object detection models based on fractal loss function[J]. Fractal and Fractional, 2022, 6(12): 120706. doi: 10.3390/fractalfract6120706
|
[17] |
Mery D, Riffo V, Zscherpel U, et al. GDXray: The database of X-ray images for nondestructive testing[J]. Journal of Nondestructive Evaluation, 2015, 34(4): 1 − 12.
|
[18] |
Chen L, Tian X, Chai G, et al. A new CBAM-P-Net model for few-shot forest species classification using airborne hyperspectral images[J]. Remote Sensing, 2021, 13(7): 1269. doi: 10.3390/rs13071269
|
[19] |
Dong Z, Li G, Liao Y, et al. Centripetalnet: Pursuing high-quality keypoint pairs for object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Arxiv. 2020: 10519 − 10528.
|
[20] |
Ren S, He K, Girshick R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. Institute of Electrical and Electronics Engineers, 2017, 39(6): 1137 − 1149.
|
[21] |
Cai Z, Vasconcelos N. Cascade: Delving into high quality object detection[C]//Proceedings of the IEEE Conference on Computer vision and Pattern Recognition, Arxiv. 2018: 6154 − 6162.
|
[22] |
Redmon J, Farhadi A. Yolov3: An incremental improvement[J]. Astrophysicd Journal, 2018(7): 1804.
|
[1] | XIE Yuxin, GONG Yefei, GU Xinhao, CHEN Xiaobin, WANG Meng, XU Huigang. Research on weld surface defect detection method based on RGB-D feature fusion[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(12): 72-78. DOI: 10.12073/j.hjxb.20230712002 |
[2] | ZHU Ming, LEI Runji, WENG Jun, WANG Jincheng, SHI Yu. MIG weld seam tracking system based on image automatic enhancement and attention mechanism deep learning[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(11): 90-94. DOI: 10.12073/j.hjxb.20240718002 |
[3] | XU Donghui, MENG Fanpeng, SUN Peng, ZHENG Xuchen, CHENG Yongchao, MA Zhi, CHEN Shujun. Online monitoring of GMAW welding defect based on deep learning[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(3): 114-119. DOI: 10.12073/j.hjxb.20230117002 |
[4] | WANG Rui, HU Yunlei, LIU Weipeng, LI Haitao. Defect detection of weld X-ray image based on edge AI[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2022, 43(1): 79-84. DOI: 10.12073/j.hjxb.20210516001 |
[5] | LIU Tianyuan, BAO Jinsong, WANG Junliang, ZHENG Xiaohu, WANG Jiacheng. Adaptive edge detection of molten pool based on coarse-grained regularization in restricted solution space[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2020, 41(12): 49-54. DOI: 10.12073/j.hjxb.20200815002 |
[6] | LI Hexi, HAN Xinle, FANG Zaojun. A visual model of welding robot based on CNN deep learning[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(2): 154-160. DOI: 10.12073/j.hjxb.2019400060 |
[7] | GAO Weixin, HU Yuheng, WU Xiaomeng. A new algorithm for detecting defects of sub-arc welding x-ray image based on compress sensor theory[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2015, 36(11): 85-88. |
[8] | LI Xueqin, LIU Peiyong, YIN Guofu, JIANG Honghai. Weld defect detection by X-ray images method based on Fourier fitting surface[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2014, 35(10): 61-64. |
[9] | CAI Guorui, DU Dong, TIAN Yuan, HOU Runshi, GAO Zhiling. Defect detection of X-ray images of weld using optimized heuristic search based on image information fusion[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2007, (2): 29-32. |
[10] | SUN Yi, SUN Hong-yu, BAI Peng, WANG Yu, TIAN Yan-ping. Real-time automatic detection of weld defects in X-ray images[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2004, (2): 115-118,122. |