|
|
|
|
|
|
Multi-Spectral Ship Target Recognition Based on Feature Level Fusion |
LIU Feng1, SHEN Tong-sheng2, GUO Shao-jun1,ZHANG Jian3 |
1. Naval Aeronautical and Astronautical University Department of Control Engineering, Yantai 264001, China
2. National Defense Science and Technology Information Center, Beijing 100142, China
3. PLA No.91206 Troops, Qingdao 264001, China |
|
|
Abstract Aiming at solving the problem of inadequate ability of recognizing single band warship targets on the sea in complicated situations, image fusion technology for three band feature levels of visible light, short wave infrared and medium wave infrared has been studied. Problems of time-consuming and fusion strategy existed in image fusion have been solved as top priorities. A new multi-band fusion method based on regional covariance matrix has been proposed in this paper. The advantage is that it can fuse several related features naturally through low dimensional vector. This paper has designed 11-dimensional and 5-dimensional feature vectors for visible light image and infrared image respectively, which not only ensures the differences among different targets but also decreases the calculation. Saliency detection has been adopted firstly in this paper to position the target area in the image quickly; and then, distance calculation formula of covariance matrix has been defined for the feature vectors of different band image designs and matching has been made in the following; integral image has been attained through one traversal operation for the image; purpose of quick calculation has been realized in the calculation for covariance; finally, K-nearest neighbor (KNN) algorithm has been adopted to make classification and recognition for various warship targets. Over 3 400 images of three-band warship target have been used as testing data. The experiment mainly includes two parts: first, comparing the recognition rate of single-band and three-band fusion recognition and to verify that the fusion method proposed in this paper has more extensive application range. Second, comparing several traditional pixel level methods in the calculation efficiency to verify the advantages of feature fusion adopted in this paper in calculation time. Experimental results have shown that the recognition rate of this method can reach 95.1% and time for single frame calculation is about 0.5 s, which has made distinctive improvement in both real time and detection rate.
|
Received: 2016-09-07
Accepted: 2016-12-30
|
|
|
[1] Hassen R, Zhou W, Salama M. IEEE Trans. Image Process., 2015, 24(9): 2714.
[2] Adu J, Gan J, Wang Y, et al. Infrared Physics & Technology, 2013, 61(5): 94.
[3] Qu X J, Zhang F, Zhang Y. Applied Mechanics and Materials,2013, 347: 2380.
[4] Lan X Y, Andy J, Pong C. IEEE Trans. Image Process., 2015, 24(12): 5826.
[5] YANG Guang, TONG Tao, LU Song-yan, et al(杨 桄, 童 涛, 陆松岩, 等). Optics and Precision Engineering(光学精密工程), 2014, 22(2): 489.
[6] Liu H, Yu Y L, Sun F C, et al. IEEE Transactions on Automation Science and Engineering, 2016, 99: 1.
[7] Yuan Y H, Sun Q S. Neurocomputing, 2013, 122(5): 229.
[8] Wu Y, Cheng J, Wang J, et al. IEEE Transactions on Image Processing, 2012, 21(5): 2824.
[9] Cheng M M, Zhang G X, Mitra X, et al. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 409.
[10] Krahenbuhl P. IEEE Conference on Computer Vision & Pattern Recognition, 2012, 157: 733.
[11] Yang C, Zhang L, Lu H, et al. IEEE Conference on Computer Vision and Pattern Recognition, 2013, 9: 3166.
[12] Bai X, Zhou F, Xue B. Optics Express, 2011, 19(9): 8444.
[13] Shi Z, Xu J, Zhang Y, et al. Infrared Physics & Technology, 2015, 71: 363. |
[1] |
LI Si-yuan, JIAO Jian-nan, WANG Chi*. Specular Reflection Removal Method Based on Polarization Spectrum
Fusion and Its Application in Vegetation Health Monitoring[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3607-3614. |
[2] |
ZHU Wen-qing1, 2, 3, ZHANG Ning1, 2, 3, LI Zheng1, 2, 3*, LIU Peng1, 3, TANG Xin-yi1, 3. A Multi-Task Convolutional Neural Network for Infrared and Visible Multi-Resolution Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 289-296. |
[3] |
XU Xue-bin1, 2, XING Xiao-min1, 2*, AN Mei-juan1, 2, CAO Shu-xin1, 2, MENG Kan1, 2, LU Long-bin1, 2. Palmprint Recognition Method Based on Multispectral Image Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3615-3625. |
[4] |
CUI Xiao-rong, SHEN Tao*, HUANG Jian-lu, SUN Bin-bin. Infrared Mid-Wave and Long-Wave Image Fusion Based on FABEMD and Improved Local Energy Window[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2043-2049. |
[5] |
SHEN Yu, YUAN Yu-bin*, PENG Jing. Research on Near Infrared and Color Visible Fusion Based on PCNN in Transform Domain[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2023-2027. |
[6] |
WU Jin-hui1, 2, YU Jun-zhi1*, LIU Han-qi3, WANG Gao2, 4. Research on Polarization Spectrum Imaging System Based on Orthogonal Modulation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(07): 2315-2319. |
[7] |
CHENG Cheng1, GAO Min1, CHENG Xu-de2, FANG Dan1, CHEN Yi-chao3. Research on Fast Target Recognition Method Based on Spectrum Detection in Battlefield[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(01): 161-165. |
[8] |
ZHANG Jin1, WANG Jie1, SHEN Yan3, ZHANG Jin-bo4, CUI Hong-liang1,2*, SHI Chang-cheng2*. Wavelet-Based Image Fusion Method Applied in the Terahertz Nondestructive Evaluation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(12): 3683-3688. |
[9] |
LI Dong-ming1, 2, BI Hai-ping1, LIU Zhi-chao2, YANG Jin-hua2*, ZHANG Li-juan2, 3, WANG Liang4, CHEN Gui-fen1. Research on Target Recognition System for Camouflage Target Based on Dual Modulation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(04): 1174-1178. |
[10] |
LIU Jia-ni, JIN Wei-qi*, LI Li, WANG Xia . Visible and Infrared Thermal Image Fusion Algorithm Based on Self-Adaptive Reference Image [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(12): 3907-3914. |
[11] |
LIN Su-zhen, WANG Dong-juan, WANG Xiao-xia, ZHU Xiao-hong. Multi-Band Texture Image Fusion Based on the Embedded Multi-Scale Decomposition and Possibility Theory[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(07): 2337-2343. |
[12] |
YAN Xiao-yan1, 2, QIN Jian-min1, QIAO Ji-pin1 . Research on Multi-Spectral Target Recognition System Based on the Magneto-Optical Modulation[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(03): 864-867. |
[13] |
WANG Bo1, GAO Yu-bin2, LU Xu-tao3 . Research on Anti-Camouflaged Target System Based on Spectral Detection and Image Recognition [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(05): 1440-1444. |
[14] |
LI Jian-min, WANG Gao . High-Speed Target Recognition Positioning System Based on
Multi-Spectral Radiation Characteristics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(11): 3147-3151. |
[15] |
LIN Su-zhen, YANG Feng-bao, CHEN Lei . Fusion of Dual Color MWIR Images Based on Support Value Transform and top-hat Decomposition [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2014, 34(04): 1144-1150. |
|
|
|
|