An ultrasonic image mosaic method based on improved SIFT algorithm

CHI Dazhao; XU Zhixian; LIU Haichun; LI Qingsheng; GUO Qiang; SU Weigang; JIA Tao

doi:10.12073/j.hjxb.20240630001

TRANSACTIONS OF THE CHINA WELDING INSTITUTION > 2024 > 45(10): 1-7. > DOI: 10.12073/j.hjxb.20240630001

CHI Dazhao, XU Zhixian, LIU Haichun, LI Qingsheng, GUO Qiang, SU Weigang, JIA Tao. An ultrasonic image mosaic method based on improved SIFT algorithm[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(10): 1-7. DOI: 10.12073/j.hjxb.20240630001

Citation:

PDF (6325 KB)

An ultrasonic image mosaic method based on improved SIFT algorithm

1.
National Key Laboratory of Precision Welding and Joining of Materials and Structures, Harbin Institute of Technology, Harbin, 150001, China
2.
PipeChina Engineering Quality Supervision and Inspection Company, Beijing, 100013, China

More Information

Received Date: June 29, 2024
Available Online: September 26, 2024

Graphical Abstract

Abstract

Abstract

A comprehensive non-destructive testing of large structures usually needs a series of C-scans. In order to obtain a panoramic image of the structure under test, the method of sub-image mosaic is studied. According to the dynamic process of ultrasonic imaging and combined with digital image processing technology, an improved image mosaic method for ultrasonic C-scan detection is proposed based on the traditional scale invariant feature transform (SIFT) algorithm. Firstly, in view of the low success rate of ultrasound image registration using the traditional SIFT algorithm, the obtained matching feature points are screened through the vector difference of the starting positions of ultrasonic probe. Secondly, a dynamic programming method is used to find the best stitching path. Finally, a gradual in and out fusion is carried out along the best path for stitching to improve the visual effect of the fused area. Artificial defect contained block and welded piece are prepared and tested. The results of ultrasonic image mosaic show that the improved SIFT algorithm can effectively stitch multiple ultrasonic C-scan sub-images into panoramic images, and the proposed method has high accuracy of feature point matching and small image fusion distortion, which is better than the conventional SIFT image mosaic algorithm. In the mosaic image, the positions of targets match well, which can achieve overall non-destructive evaluation of structural processing quality.
- non-destructive testing,
- ultrasonic imaging,
- image mosaic,
- SIFT algorithm

FullText(HTML)

References (15)

References

[1]	张晨昊, 陈兵, 刘恒, 等. 增材制造AlSi10Mg超声横波和纵波孔隙率检测对比分析[J]. 焊接学报, 2023, 44(10): 111 − 119. doi: 10.12073/j.hjxb.20230414001 Zhang Chenhao, Chen Bing, Liu Heng, et al. Comparison of ultrasonic transverse and longitudinal wave porosity detection in additive manufacturing of AlSi10Mg[J]. Transactions of the China Welding Institution, 2023, 44(10): 111 − 119. doi: 10.12073/j.hjxb.20230414001
[2]	王斌, 李升, 朱富慧, 等. 基于超声无损检测的扩散连接界面缺陷尺寸评估[J]. 焊接学报, 2020, 41(8): 34 − 38. doi: 10.12073/j.hjxb.20200323004 Wang Bin, Li Sheng, Zhu Fuhui, et al. Evaluation on interfacial defect size of diffusion bonding based on ultrasonic non-destructive testing[J]. Transactions of the China Welding Institution, 2020, 41(8): 34 − 38. doi: 10.12073/j.hjxb.20200323004
[3]	迟大钊, 郭涛, 张闰琦, 等. 声阻法胶接结构缺陷实时成像检测[J]. 焊接学报, 2022, 43(11): 107 − 111. doi: 10.12073/j.hjxb.20220702001 Chi Dazhao, Guo Tao, Zhang Runqi, et al. Study on real-time imaging detection of bonding defects by acoustic impedance method[J]. Transactions of the China Welding Institution, 2022, 43(11): 107 − 111. doi: 10.12073/j.hjxb.20220702001
[4]	陈尧, 冒秋琴, 石文泽, 等. 基于相位相干性的厚壁焊缝TOFD成像检测研究[J]. 机械工程学报, 2019, 55(4): 25-32. Chen Yao, Mao Qiuqin, Shi Wenze, et al. Research on ultrasonic TOFD imaging inspection for heavy-walled weld based on phase coherence characteristics[J] Journal of Mechanical Engineering. 2019, 55(4): 25-32.
[5]	Bazulin E G. TOFD echo signal processing to achieve superresolution[J]. Russian Journal of Nondestructive Testing, 2021, 57(5): 352 − 360. doi: 10.1134/S1061830921050053
[6]	王锐, 刘志宏, 吴杰峰, 等. 316L对接焊缝相控阵超声检测工艺模拟与试验验证[J]. 焊接学报, 2019, 40(11): 33 − 38. doi: 10.12073/j.hjxb.2019400284 Wang Rui, Liu Zhihong, Wu Jiefeng, et al. Simulation and experimental verification of phased array ultrasonic testing process in 316L butt weld[J]. Transactions of the China Welding Institution, 2019, 40(11): 33 − 38. doi: 10.12073/j.hjxb.2019400284
[7]	汪认, 赵鹏, 何建英, 等. 基于超声相控阵的耐候钢接头疲劳裂纹动态监测[J]. 焊接学报, 2022, 43(12): 100 − 104. doi: 10.12073/j.hjxb.20211117001 Wang Ren, Zhao Peng, He Jianying, et al. Fatigue crack dynamic monitoring of weathering steel joint based on ultrasonic phased array[J]. Transactions of the China Welding Institution, 2022, 43(12): 100 − 104. doi: 10.12073/j.hjxb.20211117001
[8]	杨敬, 吴斌, 焦敬品, 等. 奥氏体不锈钢焊缝超声阵列检测方法[J]. 焊接学报, 2022, 43(2): 1 − 10. doi: 10.12073/j.hjxb.20210617001 Yang Jing, Wu Bin, Jiao Jingpin, et al. Nondestructive testing of austenitic welds using method of ultrasonic array[J]. Transactions of the China Welding Institution, 2022, 43(2): 1 − 10. doi: 10.12073/j.hjxb.20210617001
[9]	Chen L L, Zhao Y Q, Kong S G. SFA-guided mosaic transformer for tracking small objects in snapshot spectral imaging[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2023, 204: 223 − 236. doi: 10.1016/j.isprsjprs.2023.09.015
[10]	Liu Y F, Zhao, X N, Song Z H, et al. Detection of apple mosaic based on hyperspectral imaging and three-dimensional gabor[J]. Computers and Electronics in Agriculture, 2024, 222: 109051 doi: 10.1016/j.compag.2024.109051
[11]	Zhang K, Yin C, Cheng Y H, et al. Rapid defect detection for spacecraft in infrared reconstructed images using image mosaic technique[C]//The 21st World Congress of the International Federation of Automatic Control (IFAC), July 12-17, 2020, Berlin. San Francisco: Curran and Associates, Inc. , 2020: 5695-5700.
[12]	Lowe D G. Distinctive image features from scale-invariant interest points[J]. International Journal Of Computer Vision, 2004, 60(2): 91 − 110. doi: 10.1023/B:VISI.0000029664.99615.94
[13]	Huang Q H, Deng Q F, Li L, et al. Scoliotic imaging with a novel double-sweep 2.5-dimensional extended field-of-view ultrasound[J]. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2019, 66(8): 1304 − 1315. doi: 10.1109/TUFFC.2019.2920422
[14]	Tsourounis D, Kastaniotis D, Theoharatos C, et al. SIFT-CNN: when convolutional neural networks meet dense SIFT descriptors for image and sequence classification[J]. Journal of Image, 2022, 8(10): 256.
[15]	Wang F B, Paul T b, Chen W, et al. Multi-image mosaic with SIFT and vision measurement for microscale structures processed by femtosecond laser[J]. Optics and Lasers in Engineering, 2018, 100: 124 − 130. doi: 10.1016/j.optlaseng.2017.08.004

[1]	HAN Mei, ZHANG Xi, MA Qingjun, WEI Yushun, WEI Chen, WANG Zejun, JIA Yunhai. The effect of trace elements on the microstructure and properties of coarse grain heat affected zone of EH36 ship steel with super large heat input[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2024, 45(2): 47-53. DOI: 10.12073/j.hjxb.20230301001
[2]	CAO Rui, YANG Zhaoqing, LI Jinmei, LEI Wanqing, ZHANG Jianxiao, CHEN Jianhong. Influence of fraction of coarse-grained heat affected zone on impact toughness for 09MnNiDR welded joint[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2020, 41(5): 7-13. DOI: 10.12073/j.hjxb.20190818003
[3]	SU Xiaohu, LI Zhuoxin, LI Hong, JinKim Hee, MENG Bo. Microstructure to properties of coarse grained heat affected zone in deposited weld metal of metal cored wire E120C-K4[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2019, 40(10): 48-53. DOI: 10.12073/j.hjxb.2019400262
[4]	ZHANG Lei, LIU Changqing, YU Jingwei, HU Xihai, GONG Feng, JIN Guangri. Numerical analysis of microstructure evolution of coarse grained zone in sidewall during narrow gap submerged arc welding[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2016, 37(4): 103-106.
[5]	HU Meijuan, WANG Peng, HAN Xinli, JI Lingkang. Microstructure and properties of coarse grain region for high-strain pipeline X80 steel[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2012, (9): 93-96.
[6]	CHAI Feng, SU Hang, YANG Caifu, LUO Xiaobing. Coarse grained region microstructure and properties of high heat input welding DH36 steels[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2010, (12): 25-28.
[7]	ZHANG Yingqiao, ZHANG Hanqian, LIU Weiming. Effects of M-A constituent on toughness of coarse grain heat-affected zone in HSLA steels for oil tanks[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2009, (1): 109-112.
[8]	WU Wei, GAO Hongming, WU Lin. Microstructures in CGHAZ and mechanical properties of welded joint during welding of fine grain titanium alloy[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2008, (1): 61-64.
[9]	CHAI Feng, YANG Cai-fu, ZHANG Yong-quan, SU Hang, XU Zhou. Coarse-grained heat affected zone microstructure and toughness of copper-bearing age-hardening steels[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 2006, (6): 56-60.
[10]	Wu Zhantian, Guo Jiuzhu, Zhou Zhenhua, Zhu Hong, Wang Xiaoyu. Structure and property of coarse-grained zone in weld of a high strength low alloy 20Mn2WNbB steel studied by thermal simulation[J]. TRANSACTIONS OF THE CHINA WELDING INSTITUTION, 1995, (1): 40-44.

Cited By

Cited by

Periodical cited type(1)

马晓锋，夏攀，刘海生，史铁林，王中任. 全位置焊接熔池的深度学习检测方法. 机械工程学报. 2023(12): 272-283 .

Other cited types(0)

Get Citation

PDF

XML

Article views (249) PDF downloads (88) Cited by(1)

Turn off MathJax

Article Contents

Abstract

References

An ultrasonic image mosaic method based on improved SIFT algorithm