| 光谱学与光谱分析 |
|
|
|
|
|
| A Study on the Outlier Mining System for LAMOST Spectra |
| ZHANG Ji-fu1, 2,CAI Jiang-hui1 |
1. School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, China
2. National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100080, China |
|
|
|
|
Abstract To find unknown celestial bodies is one of main goals in mankind’s universe exploration, and outlier mining is a kind of effective way of finding unknown celestial bodies from mass spectrum data. In the present work, using VC++ and Oracle9i as development tools, an outlier mining system for star spectra is designed and realized, and its software architecture and function modules are outlined. At the same time, the system’s key components such as star spectrum data preprocessing based on median filters, clustering of star spectrum data based on distance, outlier mining of star spectrum data based on distance support and three-dimensional visualization of star spectrum outlier based on PCA, are elaborated. The preliminary experimental results based on SDSS star spectrum data show that the system is workable for outlier mining of celestial body spectrum data, and a new kind of effective way of finding unknown and peculiar celestial body spectrum data.
|
|
Received: 2005-12-05
Accepted: 2006-04-21
|
|
|
|
Corresponding Authors:
ZHANG Ji-fu
E-mail: jifuzh@sina.com
|
|
[1] ZHAO Rui-zhen, HU Zhan-yi, ZHAO Yong-heng(赵瑞珍，胡占义，赵永恒). Spectroscopy and Spectral Analysis(光谱学与光谱分析)，2005，25(1)：153.
[2] QIN Dong-mei，HU Zhan-yi, ZHAO Yong-heng(覃冬梅，胡占义，赵永恒). Spectroscopy and Spectral Analysis(光谱学与光谱分析)，2003，23(1)：182.
[3] LIU Rong, LIU San-yang, ZHAO Rui-zhen(刘 蓉，刘三阳，赵瑞珍). Spectroscopy and Spectral Analysis(光谱学与光谱分析)，2006，26(3)：583.
[4] QIU Bo，HU Zhan-yi, ZHAO Yong-heng (邱 波，胡占义，赵永恒). Spectroscopy and Spectral Analysis(光谱学与光谱分析)，2002，22(3)：523.
[5] Barnett V, Lewis T. Outliers in Statistical Data. New York: John Wiley & Sons, 1994.
[6] Luis Malagon-Borja, Olac Fuentes. An Object Detection System Using Image Reconstruction with PCA，The 2nd Canadian Conference on Computer and Robot Vision (CRV’05), 2.
[7] HUANG Xi-tao(黄熙涛). Two-dimensional Digital Signal Processing Ⅱ: Transforms and Median Filters (二维数字信号处理Ⅱ: 变换与中值滤波器). Beijing: Science Technology Press(北京：科学技术出版社)，1985.
[8] Karypis G, Han E H，Kumar V. IEEE Computer, 1999, 32(8): 68. |
| [1] |
LIU Zhen1*, LIU Li2*, FAN Shuo2, ZHAO An-ran2, LIU Si-lu2. Training Sample Selection for Spectral Reconstruction Based on Improved K-Means Clustering[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 29-35. |
| [2] |
GUO Ya-fei1, CAO Qiang1, YE Lei-lei1, ZHANG Cheng-yuan1, KOU Ren-bo1, WANG Jun-mei1, GUO Mei1, 2*. Double Index Sequence Analysis of FTIR and Anti-Inflammatory Spectrum Effect Relationship of Rheum Tanguticum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 188-196. |
| [3] |
XU Rong1, AO Dong-mei2*, LI Man-tian1, 2, LIU Sai1, GUO Kun1, HU Ying2, YANG Chun-mei2, XU Chang-qing1. Study on Traditional Chinese Medicine of Lonicera L. Based on Infrared Spectroscopy and Cluster Analysis[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(11): 3518-3523. |
| [4] |
JIA Hao1, 3, 4, ZHANG Wei-fang1, 3, LEI Jing-wei1, 3*, LI Ying-ying1, 3, YANG Chun-jing2, 3*, XIE Cai-xia1, 3, GONG Hai-yan1, 3, DING Xin-yu1, YAO Tian-yi1. Study on Infrared Fingerprint of the Classical Famous
Prescription Yiguanjian[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3202-3210. |
| [5] |
LI Xin-li1, CONG Li-li2, XU Shu-ping2, LI Su-yi1*. Cell Growth Analysis Method Based on Spectral Clustering and Single-Cell Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2832-2836. |
| [6] |
LIU Si-qi1, FENG Guo-hong1*, TANG Jie2, REN Jia-qi1. Research on Identification of Wood Species by Mid-Infrared Spectroscopy Based on CA-SDP-DenseNet[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 814-822. |
| [7] |
LI Zi-yi1, LI Rui-lan1, LI Can-lin1, WANG Ke-ru2, FAN Jiu-yu3, GU Rui1*. Identification of Tibetan Medicine Zhaxun by Infrared Spectroscopy
Combined With Chemometrics[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 526-532. |
| [8] |
LI Xiao1, CHEN Yong2, MEI Wu-jun3*, WU Xiao-hong2*, FENG Ya-jie1, WU Bin4. Classification of Tea Varieties Using Fuzzy Covariance Learning
Vector Quantization[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(02): 638-643. |
| [9] |
CHEN Yong1, 2, GUO Yun-zhu1, WANG Wei3*, WU Xiao-hong1, 2*, JIA Hong-wen4, WU Bin4. Clustering Analysis of FTIR Spectra Using Fuzzy K-Harmonic-Kohonen Clustering Network[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(01): 268-272. |
| [10] |
SHANG Chao-nan1, XIE Yan-li2, GAO Xiao3, ZHOU Xue-qing2, ZHAO Zhen-dong2, MA Jia-xin1, CUI Peng3, WEI Xiao-xiao3, FENG Yu-hong1, 2*, ZHANG Ming-nan2*. Research on Qualitative and Quantitative Analysis of PE and EVA in Biodegradable Materials by FTIR[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3380-3386. |
| [11] |
WU Bing, YANG Ke-ming*, GAO Wei, LI Yan-ru, HAN Qian-qian, ZHANG Jian-hong. EC-PB Rules for Spectral Discrimination of Copper and Lead Pollution Elements in Corn Leaves[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3256-3262. |
| [12] |
YI Can-can1, 2, 3, 5*, TUO Shuai1, 2, 3, TU Shan1, 2, 3, 4, ZHANG Wen-tao5. UMAP-Assisted Fuzzy C-Clustering Method for Recognition of
Terahertz Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(09): 2694-2701. |
| [13] |
ZHOU Ming-rui1, 2, QU Jiang-bei2, LI Peng1, 2*, HE Yi-liang1, 2. The “Cluster-Regression” COD Prediction Model of Distributed Rural Sewage Based on Three-Dimensional Fluorescence Spectrum and
Ultraviolet-Visible Absorption Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2113-2119. |
| [14] |
CHEN Wei-na1, GUO Zhong-zheng1, LI Kai-kai1, YANG Yu-zhu1, YANG Xu2*. Micro Confocal Raman Spectroscopy Combined With Chemometrical Method for Forensic Differentiation of Electrostatic Copy Paper[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2033-2038. |
| [15] |
YUAN Li1, XIE Bei-bei2, CUI Yong-qiang2, ZHANG Xiao-dan2, JIAO Hui-hui2. Research on Oil Spill Status Recognition Based on LIF[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(07): 2018-2024. |
|
|
|
|
