|
|
|
|
|
|
LAMOST Unknown Spectral Analysis Based on Influence Space and Data Field |
YANG Yu-qing1, CAI Jiang-hui1, 2*, YANG Hai-feng1*, ZHAO Xu-jun1, YIN Xiao-na1 |
1. School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, China
2. School of Computer Science and Technology, North University of China, Taiyuan 030051, China
|
|
|
Abstract Based on the spectral data classified as Unknown by LAMOST DR5 Pipeline, the characteristics of low-quality spectra are extracted, and clustering analysis is conducted in this paper. The main work includes: (1) Feature extraction based on influence space and the data field. Firstly, a large number of small clusters are extracted from the low SNR spectrum based on influence space; secondly, each small cluster’s data field is calculated, and the spectrum is sorted using the above field; and then, access the sorted spectrum and the members in its small cluster to obtain the characteristic spectrum. (2) Carry out K-means clustering with the above characteristic spectrum and statistics on the sky area, observed visual ninety, the signal-to-noise ratio in each band, brightness, and spectrometer/fiber distribution for each class of targets. (3) Analysis of clustering results of the low SNR spectra. All low-quality spectra are divided into five categories through cluster analysis: A. The spectral SNR is low, or the spectrum is different from the traditional classification template, but its category can be determined by feature analysis (accounting for 2.7%); B. Suspected characteristic lines or molecular bands that do not match the line table appear at the blue or red end of the spectrum (accounting for 23.6%); C. The SNR at the spectrum’s blue end is very low, and the noise value in this wavelength region is strong. While in other wavelength regions, the features of continuous spectrum and line are weak (accounting for 48%); D. Due to the splicing problem, a protrusion can be seen in the local spectrum between 5 700 and 5 900 Å, and the continuum and line characteristics are poor at other wavelengths (accounting for 24.2%); E. Many default values make it impossible to determine the category of the spectrum (accounting for 1.5%). The experimental results show that this method can not only effectively extract the characteristic spectrum of low SNR spectrum, but also effectively carry out clustering analysis on the characteristic spectrum to reveal their causes, to provide a reference for the formulation of spectrum observation plan and the analysis and processing of low SNR spectrum.
|
Received: 2021-07-23
Accepted: 2022-01-19
|
|
Corresponding Authors:
CAI Jiang-hui, YANG Hai-feng
E-mail: Jianghui@tyust.edu.cn; hfyang@tyust.edu.cn
|
|
[1] Luo A L, Zhang Y X, Zhao Y H. Advanced Software, Control, and Communication Systems for Astronomy, 2004, 5496: 756.
[2] Luo A L, Wu Y, Zhao J K, et al. Advanced Software and Control for Astronomy II, 2008, 7019: 701935.
[3] QU Cai-xia, YANG Hai-feng, CAI Jiang-hui, et al(屈彩霞,杨海峰,蔡江辉,等). Spectroscopy and Spectral Analysis(光谱学与光谱分析), 2020, 40(4): 1304.
[4] Luo A L, Zhang J N, Chen J J, et al. Setting the Scene for Gaia and LAMOST, 2014, 9(298): 428.
[5] Xie L. Chinese Astronomy and Astrophysics, 2019, 43(4) : 579.
[6] Pan J. Research in Astronomy and Astrophysics, 2020, 20(9): 146.
[7] Chakrabarti D, Maji T, Mondal C, et al. Physical Review D, 2017, 95(7): 074028.
[8] Robnik J, Seljak U. Monthly Notices of the Royal Astronomical Society, 2021, 504(4): 5829.
[9] Yang Y Q, Cai J H, Yang H F, et al. Expert Systems with Application, 2020, 139: 112846.
[10] Thébault E, Lesur V, Kauristie K, et al. Space Science Reviews, 2017, 206(1-4): 191.
|
[1] |
LIANG Ye-heng1, DENG Ru-ru1, 2*, LIANG Yu-jie1, LIU Yong-ming3, WU Yi4, YUAN Yu-heng5, AI Xian-jun6. Spectral Characteristics of Sediment Reflectance Under the Background of Heavy Metal Polluted Water and Analysis of Its Contribution to
Water-Leaving Reflectance[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 111-117. |
[2] |
GUO Ya-fei1, CAO Qiang1, YE Lei-lei1, ZHANG Cheng-yuan1, KOU Ren-bo1, WANG Jun-mei1, GUO Mei1, 2*. Double Index Sequence Analysis of FTIR and Anti-Inflammatory Spectrum Effect Relationship of Rheum Tanguticum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 188-196. |
[3] |
XU Rong1, AO Dong-mei2*, LI Man-tian1, 2, LIU Sai1, GUO Kun1, HU Ying2, YANG Chun-mei2, XU Chang-qing1. Study on Traditional Chinese Medicine of Lonicera L. Based on Infrared Spectroscopy and Cluster Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3518-3523. |
[4] |
JIA Hao1, 3, 4, ZHANG Wei-fang1, 3, LEI Jing-wei1, 3*, LI Ying-ying1, 3, YANG Chun-jing2, 3*, XIE Cai-xia1, 3, GONG Hai-yan1, 3, DING Xin-yu1, YAO Tian-yi1. Study on Infrared Fingerprint of the Classical Famous
Prescription Yiguanjian[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3202-3210. |
[5] |
LIU Si-qi1, FENG Guo-hong1*, TANG Jie2, REN Jia-qi1. Research on Identification of Wood Species by Mid-Infrared Spectroscopy Based on CA-SDP-DenseNet[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 814-822. |
[6] |
CHEN Yong1, 2, GUO Yun-zhu1, WANG Wei3*, WU Xiao-hong1, 2*, JIA Hong-wen4, WU Bin4. Clustering Analysis of FTIR Spectra Using Fuzzy K-Harmonic-Kohonen Clustering Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 268-272. |
[7] |
DAI Qian-cheng1, XIE Yong1*, TAO Zui2, SHAO Wen1, PENG Fei-yu1, SU Yi1, YANG Bang-hui2. Research on Fluorescence Retrieval Algorithm of Chlorophyll a Concentration in Nanyi Lake[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3941-3947. |
[8] |
SHANG Chao-nan1, XIE Yan-li2, GAO Xiao3, ZHOU Xue-qing2, ZHAO Zhen-dong2, MA Jia-xin1, CUI Peng3, WEI Xiao-xiao3, FENG Yu-hong1, 2*, ZHANG Ming-nan2*. Research on Qualitative and Quantitative Analysis of PE and EVA in Biodegradable Materials by FTIR[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3380-3386. |
[9] |
CHEN Wei-na1, GUO Zhong-zheng1, LI Kai-kai1, YANG Yu-zhu1, YANG Xu2*. Micro Confocal Raman Spectroscopy Combined With Chemometrical Method for Forensic Differentiation of Electrostatic Copy Paper[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2033-2038. |
[10] |
YUAN Li1, XIE Bei-bei2, CUI Yong-qiang2, ZHANG Xiao-dan2, JIAO Hui-hui2. Research on Oil Spill Status Recognition Based on LIF[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2018-2024. |
[11] |
MIAO Shu-guang1, SHAO Dan1*, LIU Zhong-yu2, 3, FAN Qiang1, LI Su-wen1, DING En-jie2, 3. Study on Coal-Rock Identification Method Based on Terahertz
Time-Domain Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(06): 1755-1760. |
[12] |
WANG Ling-ling1, 2, 3, WANG Bo1, 2, 3, XIONG Feng1, 2, 3, YANG Lu-cun1, 2, LI Jing-jing4, XIAO Yuan-ming1, 2, 3, ZHOU Guo-ying1, 2*. A Comparative Study of Inorganic Elements in Cultivativing Astragalus Membranaceus From Different Habitats[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(05): 1407-1412. |
[13] |
ZHANG Wei-fang1, 2, FAN Ke-feng3, LEI Jing-wei1, 2*, JI Liang1, 2. Infrared Fingerprint and Multivariate Statistical Analysis of Rehmannia Glutinosa[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(11): 3392-3398. |
[14] |
LIU Ting-yue1, DAI Jing-jing2*, TIAN Shu-fang1. A Neural Network Recognition Method for Garnets Subclass Based on Hyper Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(06): 1758-1763. |
[15] |
LI Meng-li, YIN Yong*, YUAN Yun-xia, LI Xin, LIU Xue-ru. Feature Selection of 3D Fluorescence Data Based on Storage Room Gas and Preliminary Early Warning of Banana Spoilage[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 558-564. |
|
|
|
|