高级检索

基于生成对抗网络数据增强与迁移学习的小样本激光软钎焊焊点缺陷检测研究

A Small-Sample Defect Detection Method for Laser Soft Soldering Solder Joints Based on GAN-Based Data Augmentation and Transfer Learning

  • 摘要: 针对激光软钎焊焊点缺陷检测中样本稀缺、重叠敏感性高、目标微小及特征复杂等问题,提出一种融合生成对抗网络(generative adversarial network,GAN)数据增强与深度迁移学习的小样本检测方法.首先,基于集成视觉系统构建PCB(printed circuit board)焊点缺陷数据集;其次,设计结合混合注意力机制和谱归一化的辅助分类生成对抗网络(auxiliary classifier generative adversarial network,ACGAN)用于图像扩增,构建YOLOv5-TL迁移学习检测模型并优化迁移策略.试验表明,数据增强使非迁移模型精度提升约2.9%,迁移学习进一步提升约5.7%,两者结合提升约11.1%;数据增强略降收敛速度,迁移学习显著加快,结合后收敛速度提升约12.5%.该方法已成功部署于激光软钎焊设备,实现焊点缺陷实时在线检测,具备良好准确性与系统稳定性,满足实际在线缺陷识别需求.

     

    Abstract: To address challenges in laser soft soldering joint defect detection, such as limited sample availability, high sensitivity to overlapping bounding boxes, small target size, and complex fine-grained features, a novel small-sample detection approach is proposed. This method integrates Generative Adversarial Network (GAN)-based data augmentation with deep transfer learning. First, a PCB solder joint defect dataset is constructed using an integrated visual acquisition system. Then, an Auxiliary Classifier GAN (ACGAN) enhanced with hybrid attention mechanisms and spectral normalization is developed for image augmentation. A YOLOv5-TL transfer learning detection model is built, and the transfer strategy is optimized accordingly. Experimental results demonstrate that the proposed data augmentation improves the detection accuracy of the non-transfer model by approximately 2.9%, while the transfer learning strategy provides an additional gain of about 5.7%. When combined, an overall improvement of around 11.1% is achieved. Although data augmentation slightly slows convergence, transfer learning significantly accelerates it, and together they improve convergence speed by about 12.5%. The proposed method has been successfully deployed in a laser soft soldering system, enabling real-time online defect detection with high accuracy and system stability, thus meeting practical application requirements.

     

/

返回文章
返回