|
|
|
|
|
|
| A Multidimensional Information Fusion Algorithm for Polarization
Spectrum Reconstruction Based on Nonsubsampled Contourlet
Transform |
| ZHONG Jing-jing1, 2, LIU Xiao1, 3, WANG Xue-ji1, 3, LIU Jia-cheng1, 3, LIU Hong1, 3, QI Chen1, 3, LIU Yu-yang1, 2, 3, YU Tao1, 3* |
1. Xi’an Institute of Optics and Precision Mechanics of Chinese Academy of Sciences, Xi’an 710119, China
2. University of Chinese Academy of Sciences, Beijing 100049, China
3. Key Laboratory Spectral Imaging Technology of Chinese Academy of Sciences, Xi’an 710119, China
|
|
|
|
|
Abstract This paper proposes a polarization spectral multidimensional information fusion method based on nonsubsampled contourlet transform to address the shortcomings of traditional optical methods that make it difficult to identify camouflaged spectral targets in complex backgrounds and the common fusion methods that tend to lead to image information loss. The multidimensional information reconstruction algorithm was designed based on the acquired multidimensional information such as target space, spectrum and polarization, and the basic data of polarization state including Stokes parameters as well as the degree of polarization and angle of polarization were extracted. NSCT is used to fuse the basic polarization parameters to improve the image’s information content and improve the camouflage’s recognition accuracy. The images Q and U with the same edge information are first decomposed using NSCT. Regional energy-weighted fusion is performed for the decomposed low-pass sub-bands; for the high-pass sub-bands, LBP features are used for weighted fusion according to the characteristics of polarization features, such as small gray value and high influence by illumination. At the same time, the proposed method is compared with four types of fusion methods, and the fusion results are evaluated objectively according to five indicators: information entropy, standard deviation, mean gradient, contrast and peak signal-to-noise ratio, and the target recognition accuracy is compared with plain images, polarized fused images and polarized hyper-spectral images. The information entropy of the fused image is 6.998 6, the standard deviation is 45.599 8, and the average gradient is 19.808 6. Compared with the original intensity, the improvements are 5.1%, 14.04%, and 7.3%, respectively, ranking first among the four types of fusion methods. It is shown that the method proposed in this paper effectively achieves polarization-based feature fusion and enhances the difference between the artificial target and the natural background. At the same time, the recognition accuracy of the fused polarized hyperspectral image for the target reaches 0.986 2, which is 21% higher than the target recognition accuracy of the single-intensity image. The experimental results show that the proposed method can effectively fuse the intensity and polarization information to improve image contrast and readability. The fused image also significantly improves target recognition accuracy, overcoming the problem of high false alarm rate of traditional spectral means for camouflage target recognition, and providing a new and effective means for new concept spectral camouflage disclosure, which has great application value.
|
|
Received: 2022-02-09
Accepted: 2022-07-04
|
|
|
|
Corresponding Authors:
YU Tao
E-mail: yutao@opt.ac.cn
|
|
[1] SUN Qiu-ju, WANG Peng, HUANG Wen-xia(孙秋菊, 王 鹏, 黄文霞). Infrared(红外), 2016, 37(1): 5.
[2] XU Wen-bin, CHEN Wei-li, LI Jun-wei(徐文斌, 陈伟力, 李军伟). Spectroscopy and Spectral Analysis（光谱学与光谱分析）, 2019, 39(1): 235.
[3] CHEN Zhen-yue, WANG Xia, ZOU Xiao-feng(陈振跃, 王 霞, 邹晓风）. Acta Photonica Sinica(光子学报), 2010, 39(S1): 43.
[4] Rahmani S, Strait M, Merkurev D, et al. IEEE Geoscience and Remote Sensing Letters, 2010, 7(4): 746.
[5] Guo Qing, Liu Shutian. Optik, 2011, 122(9): 811.
[6] Wady S M A, Bentoutou Y, Bengermikh A, et al. Advances in Space Research, 2020, 66(7): 1507.
[7] WU Yi-quan, YIN Jun, CAO Zhao-qing(吴一全, 殷 骏, 曹照清). Acta Photonica Sinica(光子学报)，2014, 43(10): 1010001.
[8] Lu H, Zhang L, Serikawa S. Computers & Mathematics with Applications, 2012, 64(5): 996.
[9] SHEN Xue-chen, LIU Jun, GAO Ming(沈薛晨, 刘 钧, 高 明). Infrared Technology(红外技术), 2020, 42(2): 182.
[10] Adu J, Gan J, Wang Y, et al. Infrared Physics & Technology, 2013, 61: 94.
[11] SHI Wen-juan(施文娟). Microcomputer & Its Applications(微型机与应用), 2012, 31(19): 45.
[12] ZHANG Ying, LI Yan-jun, ZHANG Ke(张 莹, 李言俊, 张 科). Computer Engineering and Applications(计算机工程与应用), 2011，47（3）: 196.
[13] Zhang Q, Maldague X. Infrared Physics & Technology, 2016, 74: 11.
[14] Thanki R, Kothari A, Borra S. Multimedia Tools and Applications, 2021，(3): 1.
[15] Ye Z, Fowler J E, Bai L. Journal of Applied Remote Sensing, 2017, 11( 3): 035002.
[16] Dinesh Kumar M, Babaie M, Zhu S, et al. A Comparative Study on CNN, BOVW and LBP for Classification of Histopathological Images, 2017 IEEE Symposium Series on Computational Intelligence (SSCI), 2017, 1.
|
| [1] |
ZHU Wen-jing1, 2，FENG Zhan-kang1, 2，DAI Shi-yuan1, 2，ZHANG Ping-ping3，JI Wen4，WANG Ai-chen1, 2，WEI Xin-hua1, 2*. Multi-Feature Fusion Detection of Wheat Lodging Information Based on UAV Multispectral Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 197-206. |
| [2] |
YANG Sen1, ZHANG Xin-ao1, XING Jian1, DAI Jing-min2. Study on Multi-Feature Model Fusion Variety Classification and Multi-Parameter Appearance Inspection for Milled Rice[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2837-2842. |
| [3] |
YE Wen-chao1, LUO Shui-yang1, LI Jin-hao1, LI Zhao-rong1, FAN Zhi-wen1, XU Hai-tao1, ZHAO Jing1, LAN Yu-bin1, 2, DENG Hai-dong1*, LONG Yong-bing1, 2, 3*. Research on Classification Method of Hybrid Rice Seeds Based on the Fusion of Near-Infrared Spectra and Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2935-2941. |
| [4] |
ZHANG Zhi-fen1, LIU Zi-min1, QIN Rui1, LI Geng1, WEN Guang-rui1, HE Wei-feng2. Real-Time Detection of Protective Coating Damage During Laser Shock Peening Based on ReliefF Feature Weight Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2437-2445. |
| [5] |
YANG Dong-feng1, HU Jun2*. Accurate Identification of Maize Varieties Based on Feature Fusion of Near Infrared Spectrum and Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2588-2595. |
| [6] |
BAI Xue-bing, MA Dian-kun, ZHANG Meng-jie, MA Rui-qin*. Hyperspectral Non-Destructive Analysis of Red Meat Quality: A Review[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 1993-1998. |
| [7] |
WANG Cheng-kun2, 3, ZHAO Peng1, 2*, LI Xiang-hua2. Similar Wood Species Classification Within Pterocarpus Genus Using Feature Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2247-2254. |
| [8] |
PENG Ren-miao1, 2, XU Peng-peng2, ZHAO Yi-mo2, BAO Li-jun1, LI Cheng2*. Identification of Two-Dimensional Material Nanosheets Based on Deep Neural Network and Hyperspectral Microscopy Images[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1965-1973. |
| [9] |
WANG Cheng-kun1, ZHAO Peng1，2*. Study on Simultaneous Classification of Hardwood and Softwood Species Based on Spectral and Image Characteristics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1713-1721. |
| [10] |
ZHAO Peng1,2*, HAN Jin-cheng1, WANG Cheng-kun1. Wood Species Classification With Microscopic Hyper-Spectral Imaging Based on I-BGLAM Texture and Spectral Fusion[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 599-605. |
| [11] |
ZHAO Peng*, TANG Yan-hui, LI Zhen-yu. Wood Species Recognition with Microscopic Hyper-Spectral Imaging and Composite Kernel SVM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(12): 3776-3782. |
| [12] |
LU Bing1, 2, SUN Jun1*, YANG Ning1, WU Xiao-hong1, ZHOU Xin1. Prediction of Tea Diseases Based on Fluorescence Transmission Spectrum and Texture of Hyperspectral Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2515-2521. |
| [13] |
LI Jing1, GUAN Ye-peng1, 2*, LI Wei-dong3, LUO Hong-jie4. Ancient Ceramic Kiln Non-Destructive Identification Based on Multi-Wavelength Diffuse Reflectance Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(01): 166-171. |
| [14] |
FAN Yang-yang, QIU Zheng-jun*, CHEN Jian, WU Xiang, HE Yong . Identification of Varieties of Dried Red Jujubes with Near-Infrared Hyperspectral Imaging [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(03): 836-840. |
| [15] |
KONG Xiang-bing1, SHU Ning1, TAO Jian-bin2, GONG Yan1 . A New Spectral Similarity Measure Based on Multiple Features Integration [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2011, 31(08): 2166-2170. |
|
|
|
|
