|
|
|
|
|
|
Research on the Improvement of Spectra Classification Performance With the High-Performance Hybrid Deep Learning Network |
LIU Zhong-bao1, WANG Jie2* |
1. School of Information Science, Beijing Language and Culture University, Beijing 100083, China
2. Xinjiang Astronomical Observatory, Chinese Academy of Sciences, Urumqi 830011, China
|
|
|
Abstract With the development of observation apparatus, the spectra number rises constantly. How to further improve the classification performance deserves to be research. Because of this, the stellar spectra are taken as the research object, the high-performance hybrid deep learning network is proposed based on integrating the advantages of the BERT model in feature extraction and the CNN model in automatic classification, to verify the effectiveness of improving the spectra classification performance. Firstly, the stellar spectra are input into the the BERT model; And then the part in BERT model named Transformers are used to extract the features and based on which, the feature vectors are formed; Finally, the above feature vectors are input into the CNN model, and the stellar spectra classification results can be obtained with the help of softmax classifier. Python3.7 writes the models used in the experiment and the deep learning framework named TensorFlow is introduced. The K-, F-, G-type stellar spectra in SDSS DR10 are used for the experimental dataset, normalized by the min-max normalization method. The effectiveness of the BERT-CNN model is verified by comparing with the support vector machine models (SVM) and CNN. The performances of the above models are related to the parameters, and therefore, the ten cross-validation and the grid search method are used to obtain the optimal experimental parameters. There are two parts to the experiment. One is to evaluate the classification performances of BERT-CNN with precision P, recall R and F1 values. The proportion from 30% to 70% of the experimental dataset is respectively used for the training dataset, and the remainder is used for the test dataset. P, R and F1 values rise with the training size on the K-, F-, G-type stellar datasets. In the case of the same training size, the values of P, R and F1 arrive at the highest, followed by the performance on the G-type stellar dataset, the classification results on the F-type stellar dataset are much poorer. The other experiment is to evaluate the classification performances of SVM, CNN and BERT-CNN with accuracy. The classification performances of BERT-CNN on the K-, F-, G-type stellar datasets are all best, followed by CNN. The classification accuracies of SVM are much lower than the other two models. It indicates that the BERT-CNN model contributes to improving the spectra classification performance.
|
Received: 2021-03-16
Accepted: 2021-04-22
|
|
Corresponding Authors:
WANG Jie
E-mail: wangjie@xao.ac.cn
|
|
[1] Daniel S F, Connolly A, Schneider J, et al. Astronomical Journal, 2011, 142(6): 203.
[2] Navarro S G, Corradi R L M, Mampaso A. Astronomy & Astrophysics, 2012, 538: A76.
[3] Sanchez A J, Allende P C. Astrophysical Journal, 2013, 763(1): 50.
[4] Liu Z B, Song L P, Zhao W J. Monthly Notices of the Royal Astronomical Society, 2016, 455(4): 4289.
[5] Huertas-Company M, Rouan D, Tasca L, et al. Astronomy & Astrophysics, 2008, 478(3): 971.
[6] Peng N B, Zhang Y X, Zhao Y H, et al. Monthly Notices of the Royal Astronomical Society, 2012, 425(4): 2599.
[7] Malek K, Solarz A, Pollo A, et al. Astronomy & Astrophysics, 2013, 557: A16.
[8] Brice M J, Andonie R. Astronomical Journal, 2019, 158(8): 188.
[9] Liu W, Zhu M, Dai C, et al. Monthly Notices of the Royal Astronomical Society, 2019, 483(4): 4774.
[10] WANG Nan-nan, QIU Bo, MA Jie, et al(王楠楠, 邱 波, 马 杰, 等). Spetroscopy and Spectral Analysis(光谱学与光谱分析), 2019, 39(10): 3297.
|
[1] |
CAI Hai-hui1, ZHOU Ling2, SHI Zhou3, JI Wen-jun4, LUO De-fang1, PENG Jie1, FENG Chun-hui5*. Hyperspectral Inversion of Soil Organic Matter in Jujube Orchard
in Southern Xinjiang Using CARS-BPNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2568-2573. |
[2] |
WU Chao1, QIU Bo1*, PAN Zhi-ren1, LI Xiao-tong1, WANG Lin-qian1, CAO Guan-long1, KONG Xiao2. Application of Spectral and Metering Data Fusion Algorithm in Variable Star Classification[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(06): 1869-1874. |
[3] |
LI Shuang-chuan, TU Liang-ping*, LI Xin, WANG Li-li. Besvm: A-Type Star Spectral Subtype Classification Algorithm Based on Transformer Feature Extraction[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1575-1581. |
[4] |
LU Ya-kun1, QIU Bo1*, LUO A-li2, GUO Xiao-yu1, WANG Lin-qian1, CAO Guan-long1, BAI Zhong-rui2, CHEN Jian-jun2. Classification of 2D Stellar Spectra Based on FFCNN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1881-1885. |
[5] |
LI Ling-qiao1,2, LI Yan-hui2, YIN Lin-lin4, YANG Hui-hua1,2*, FENG Yan-chun3, YIN Li-hui3, HU Chang-qin3. Data Augmentation of Raman Spectral and Its Application Research Based on DCGAN[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 400-407. |
[6] |
HE Jin-xin1, REN Xiao-yu1, CHEN Sheng-bo2*, XIONG Yue1, XIAO Zhi-qiang1, ZHOU Hai1. Automatic Classification of Rock Spectral Features Based on Fusion Learning Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 141-144. |
[7] |
JIANG Bin, ZHAO Zi-liang, WANG Shu-ting, WEI Ji-yu, QU Mei-xia*. Decomposition and Classification of Stellar Spectra Based on t-SNE[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40(09): 2913-2917. |
[8] |
ZHANG Xiao1,2, LUO A-li1*. XGBOOST Based Stellar Spectral Classification and Quantized Feature[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(10): 3292-3296. |
[9] |
WANG Jing1, YI Zhen-ping1*, YUE Li-li1, DONG Hui-fen1, PAN Jing-chang1, BU Yu-de2. Spectral Classification of M-Type Stars Based on Ensemble Tree Models[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(07): 2288-2292. |
[10] |
LIU Zhong-bao1, REN Juan-juan2, SONG Wen-ai1*, ZHANG Jing1, KONG Xiao2, FU Li-zhen1. Stellar Spectra Classification with Entropy-Based Learning Machine[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(02): 660-664. |
[11] |
LIU Rong1, QIAO Xue-jun2*, ZHANG Jian-nan3, DUAN Fu-qing4. An Automated Stellar Spectra Classification System Basing on Non-Parameter Regression and Adaboost[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2017, 37(05): 1553-1557. |
[12] |
PAN Jing-chang1, WANG Jie1, JIANG Bin1, LUO A-li1, 2, WEI Peng2, ZHENG Qiang3 . A Method of Stellar Spectral Classification Based on Map/Reduce Distributed Computing[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2016, 36(08): 2651-2654. |
[13] |
TU Liang-ping1, 3, WEI Hui-ming1, WANG Zhi-heng2*, WEI Peng3,LUO A-li3, ZHAO Yong-heng3 . Spectra Classification Based on Local Mean-Based K-Nearest Centroid Neighbor Method [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2015, 35(04): 1103-1106. |
[14] |
LI Yuan, LI Yun-mei*, SHI Kun, Lü Heng, GUO Yu-long, ZHOU Li, LIU Ge . Evaluation of Total Suspended Matter Based on Spectral Classification [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33(10): 2721-2726. |
[15] |
TU Xiao-long1,2 , HUANG Min1, Lü Qun-bo1, WANG Jian-wei1,2, PEI Lin-lin1,2 . Interference Hyperspectral Data Compression Based on Spectral Classification and Local DPCM[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2013, 33(05): 1401-1405. |
|
|
|
|