注意力机制的混合卷积高光谱图像分类方法

doi:10.3964/j.issn.1000-0593(2024)10-2916-07

Abstract
References
Related Citation (15)

Download: PDF (14442 KB)
Export: BibTeX | EndNote (RIS)

Abstract Hyperspectral Imagery (HSI), based on its high-resolution spatial and spectral information, has important applications in military, aerospace, civil, and other remote sensing fields, which has great research significance. Deep learning has the advantages of strong learning ability, wide coverage, and strong portability, which has become a hot spot in the research of high-precision hyperspectral image classification. Convolutional Neural Networks (CNN) are widely used in the research of hyperspectral image classification because of their powerful feature extraction ability and have achieved effective research results. Still, such methods are usually based on 2D-CNN or 3D-CNN alone. For the single feature of hyperspectral image, the complete feature information of hyperspectral data cannot be fully utilized. Secondly, the local feature optimization of the corresponding extraction network is good, but the overall generalization ability is insufficient. There are limitations in the deep mining of spatial and spectral information of HSI. Because of this, this paper proposes a Hybrid Spectral Convolutional Neural Network Attention Mechanism (HybridSN_AM) based on attention mechanism. The principal component analysis method is used to reduce the dimension of hyperspectral images, and the convolutional neural network is used as the main body of the classification model to screen out more distinguishable features through the attention mechanism so that the model can extract more accurate and more core joint space-spectral information, and realize high-precision classification of hyperspectral images. The proposed method was applied to three datasets: Indian Pines(IP), the University of Pavia (UP), and Salinas (SA). The experimental results show that the overall classification accuracy, average classification accuracy, and kappa coefficient of target images based on this model are higher than 98.14%, 97.17%，and 97.87%. Compared with the conventional HybridSN model, the classification accuracy of the HybridSN_AM model on the three data sets increased by 0.89%, 0.07%，and 0.73%, respectively. It effectively solves the problem of hyperspectral image joint space-spectral feature extraction and fusion, improves the accuracy of HSI classification, and has strong generalization ability. It fully verifies the effectiveness and feasibility of the attention mechanism combined with a hybrid convolutional neural network in hyperspectral image classification, which has important theoretical value for developing and applying hyperspectral image classification technology.

Key words：Hyperspectral image classification; Attention mechanism; Convolutional neural network; Multi-feature fusion; Principal component analysis

Received: 2023-06-01 Accepted: 2023-10-19

ZTFLH:

TP183

Corresponding Authors: SONG Ying E-mail: 1461591158@qq.com

Cite this article:

LIU Yu-juan,LIU Yan-da,YAN Zhen, et al. Classification of Hybrid Convolution Hyperspectral Images Based on Attention Mechanism[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(10): 2916-2922.

URL:

https://www.gpxygpfx.com/EN/10.3964/j.issn.1000-0593(2024)10-2916-07 OR https://www.gpxygpfx.com/EN/Y2024/V44/I10/2916

[1] TONG Qing-xi, ZHANG Bing, ZHANG Li-fu(童庆禧, 张兵, 张立福). National of Remote Sensing Bulletin(遥感学报)，2016, 20(5): 689.
[2] YE Zhen, BAI Lin, HE Ming-yi(叶珍, 白璘, 何明一). Journal of Image and Graphics(中国图象图形学报), 2021, 26(8): 1737.
[3] YE Cheng-ming, LI Yao, CUI Peng, et al(叶成名, 李尧, 崔鹏, 等). The Chinese Journal of Geological Hazard and Control(中国地质灾害与防治学报), 2018, 29(5): 89.
[4] Hecker C A, Riley D N, van Meijde M, et al. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(3): 1545.
[5] WU Jian-feng, HUANG Shu-cai, KANG Hong-xia, et al(吴建峰, 黄树彩, 康红霞, 等). Aerospace Technology(空天技术), 2015, 362(2): 68.
[6] Kendler S, Ron I, Cohen S, et al. IEEE Sensors Journal, 2019, 19(7): 2657.
[7] Melgani F, Bruzzone L. IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(8): 1778.
[8] SU Hong-jun(苏红军). National of Remote Sensing Bulltin, 2022, 26(8): 1504.
[9] Licciardi G, Marpu P R, Chanussot J, et al. IEEE Geoscience and Remote Sensing Letters, 2012, 9(3): 447.
[10] DUAN Xiao-chuan, WANG Guang-jun, LIANG Si-hai, et al(段小川, 王广军, 梁四海, 等). Remote Sensing Information(遥感信息), 2021, 36(3): 76.
[11] Haut J M, Paoletti M E, Plaza J, et al. IEEE Transactions on Geoscience & Remote Sensing, 2018, 56(11): 6440.
[12] Chen Y, Jiang H, Li C, et al, IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(10): 6232.
[13] GAO Hong-min, ZHU Min, CAO Xue-ying, et al(高红民, 朱敏, 曹雪莹, 等). Journal of Image and Graphics(中国图象图形学报), 2023, 28(4): 1173.
[14] SUN Wen-bin, WANG Rong, GAO Rong-hua, et al(孙文斌, 王荣, 高荣华, 等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2022, 42(5): 1572.
[15] Mourya Sharan, Amuru Sai Dhiraj, Kuchi Kiran Kumar. IEEE Wireless Communications Letters, 2023, 12(1): 40.