高级检索

基于RGB-D特征融合的焊缝表面缺陷检测方法

Research on weld surface defect detection method based on RGB-D feature fusion

  • 摘要: 金属表面焊缝缺陷的准确检测是确保工件安全使用的前提,由于缺陷与母材颜色相近、图像不清晰等情况,使用常规的2DRGB视觉难以完全检测出所有的缺陷类别,需要添加深度信息来辅助检测. 本研究提出一种基于RGB-D数据特征融合的焊缝表面缺陷检测方法,此方法在YOLOv8网络模型的基础上,利用改进的对称主干网络结构提取RGB和深度特征的有效特征层,引入RGB-D数据特征融合模块,实现了RGB特征和深度特性在空间与通道位置的融合;在YOLOv8模型中加入CIoU-NMS(complete intersection over union-non max suppression)非极大值抑制模块,提高了检验框的准确度. 针对随机包含有烧穿、飞溅、焊瘤和气孔4个类别焊缝缺陷的图像进行了试验,结果表明,改进的YOLOv8比YOLOv8漏检率下降了17.84%,误检率下降了19.54%,证明了所述方法的有效性与准确性.

     

    Abstract: The correct detection of surface defects of metal welds is the prerequisite to ensure the safe use of workpieces. Because the defects are similar in color to the base material and the images are not clear, it is difficult to completely detect all defect categories using conventional 2D RGB vision, and depth information needs to be added to assist detection. Therefore, a weld surface defect detection method based on RGB-D data feature fusion is proposed. Based on YOLOv8 network model, this method extracts effective feature layers of RGB and depth features by using improved symmetric backbone network structure, and introduces RGB-D data feature fusion module to realize the fusion of RGB and depth features in space and channel position. The CIOU-NMS non-maximum suppression module was added to YOLOv8 model to improve the accuracy of the check box. In this paper, the experiments were carried out in four categories: burn through, spatter, weld nog and stomata. The results showed that the missed detection rate of the improved YOLOv8 was reduced by 17.84% and the false detection rate by 19.54% compared with YOLOv8. The effectiveness and accuracy of the proposed method are proved.

     

/

返回文章
返回