高级检索
谢雨欣, 龚烨飞, 谷心浩, 陈晓彬, 王萌, 徐惠钢. 基于RGB-D特征融合的焊缝表面缺陷检测方法研究[J]. 焊接学报. DOI: 10.12073/j.hjxb.20230712002
引用本文: 谢雨欣, 龚烨飞, 谷心浩, 陈晓彬, 王萌, 徐惠钢. 基于RGB-D特征融合的焊缝表面缺陷检测方法研究[J]. 焊接学报. DOI: 10.12073/j.hjxb.20230712002
XIE Yuxin, GONG Yefei, GU Xinhao, CHEN Xiaobin, WANG Meng, XU Huigang. Research on weld surface defect detection method based on RGB-D feature fusion[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION. DOI: 10.12073/j.hjxb.20230712002
Citation: XIE Yuxin, GONG Yefei, GU Xinhao, CHEN Xiaobin, WANG Meng, XU Huigang. Research on weld surface defect detection method based on RGB-D feature fusion[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION. DOI: 10.12073/j.hjxb.20230712002

基于RGB-D特征融合的焊缝表面缺陷检测方法研究

Research on weld surface defect detection method based on RGB-D feature fusion

  • 摘要: 金属表面焊缝缺陷的准确检测是确保工件安全使用的前提,由于缺陷与母材颜色相近、图像不清晰等情况,使用常规的2DRGB视觉难以完全检测出所有的缺陷类别,需要添加深度信息来辅助检测. 本研究提出一种基于RGB-D数据特征融合的焊缝表面缺陷检测方法,此方法在YOLOv8网络模型的基础上,利用改进的对称主干网络结构提取RGB和深度特征的有效特征层,引入RGB-D数据特征融合模块,实现了RGB特征和深度特性在空间与通道位置的融合;在YOLOv8模型中加入CIoU-NMS(Complete Intersection over Union-Non Max Suppression)非极大值抑制模块,提高了检验框的准确度. 针对随机包含有烧穿、飞溅、焊瘤和气孔4个类别焊缝缺陷的图像进行了试验,结果表明,改进的YOLOv8比YOLOv8漏检率下降了17.84%,误检率下降了19.54%,证明了所述方法的有效性与准确性.

     

    Abstract: The accurate detection of weld defects on the metal surface is the premise to ensure the safe use of the workpiece. Due to the similar color of the defects and the unclear image of the base metal, it is difficult to completely detect all the defect categories by using the conventional 2DRGB vision, so it is necessary to add depth information to assist the detection. This study proposes a weld surface defect detection method based on RGB-D data feature fusion. Based on the YOLOv8 network model, this method uses the improved symmetrical backbone network structure to extract the effective feature layer of RGB and depth features, and introduces the RGB-D data feature fusion module. The fusion of RGB features and depth features in space and channel position is realized. The CIoU-NMS(Complete Intersection over Union-Non Max Suppression) non-maximum suppression module is added to the YOLOv8 model to improve the accuracy of the check box. The results show that the missed detection rate of the improved YOLOv8 is reduced by 17.84% and the false detection rate is reduced by 19.54% compared with YOLOv8, which proves the effectiveness and accuracy of the proposed method.

     

/

返回文章
返回