| 光谱学与光谱分析 |
|
|
|
|
|
| Distinguishing the Rare Spectra with the Unbalanced Classification Method Based on Mutual Information |
| LIU Zhong-bao1*, REN Juan-juan2, KONG Xiao3 |
1. School of Computer and Control Engineering, North University of China, Taiyuan 030051, China
2. Key Laboratory of Optical Astronomy, NAOC, Chinese Academy of Sciences, Beijing 100012, China
3. National Astronomical Observatories, Chinese Academy of Sciences, Beijing 100012, China |
|
|
|
|
Abstract Distinguishing the rare spectra from the majority of stellar spectra is one of quite important issues in astronomy. As the size of the rare spectra is much smaller than the majority of the spectra, many traditional classifiers can’t work effectively because they only focus on the classification accuracy and have not paid enough attentions on the rare spectra. In view of this, the relationship between the decision tree and mutual information is discussed on the basis of summarizing the traditional classifiers, and the cost-free decision tree based on mutual information is proposed in this paper to improve the performance of distinguishing the rare spectra. In the experiment, we investigate the performance of the proposed method on the K-type, F-type, G-type, M-type datasets from Sloan Digital Sky Survey (SDSS), Data Release 8. It can be concluded that the proposed method can complete the rare spectra distinguishing task compared with several traditional classifiers.
|
|
Received: 2015-12-14
Accepted: 2016-04-10
|
|
|
|
Corresponding Authors:
LIU Zhong-bao
E-mail: liu_zhongbao@hotmail.com
|
|
[1] Stark P B, Herron M M, Matteson A. Applied Spectroscopy, 1993, 47(11)：1820.
[2] Gulati R K, Gupta R, Gothoskar P. AJ, 1994, 426(1)：340.
[3] Bailer-Jones C A L, Irwin M, Hippel T. MNRAS, 1998, 298：361.
[4] Hernandez R D, Barreto H P, Robles L A, et al. Experimental Astronomy, 2014, 38：193.
[5] Wei P, Luo A L, Li Y B, et al. MNRAS, 2013, 431：1800.
[6] Cai J H, Zhao X J, Sun S W, et al. RAA, 2013, 13(3)：334.
[7] Gray R O, Corbally C J. AJ, 2014, 147(80)：1.
[8] Bu Y D, Pan J C, Jiang B, et al. PASJ, 2013, 65：81.
[9] Bu Y D, Chen F Q, Pan J C. New Astronomy, 2014, 28：35.
[10] Bazarghan M. Astrophysics and Space Science, 2012, 337：93.
[11] Dan D M, Hu Z Y, Zhao Y H. Spectroscopy and Specctral Analysis, 2003, 23(1)：182.
[12] Yang J F, Wu C F, Luo A L, et al. Pattern Recognition and Artificial Intelligence, 2006, 19(3)：368.
[13] Sun S W, Luo A L, Zhang J F. Astronomical Research and Technology, 2007, 4(3)：276.
[14] Liu R, Jin H M, Duan F Q. Spectroscopy and Specctral Analysis, 2010, 30(3)：838.
[15] Liu Z B, Pan G Z, Zhao W J. Journal of Electronics & Information Technology, 2013, 35(9)：2047.
[16] Liu Z B, Wang Z B, Zhao W J. Spectroscopy and Spectral Analysis, 2014, 34(1)：263.
[17] Liu Z B, Gao Y Y, Wang J Z. Spectroscopy and Spectral Analysis, 2015, 35(1)：263.
[18] Almeida J S, Prieto C A. AJ, 2013, 763: 1. |
| [1] |
GUO Feng1, ZHAO Dong-e1*, YANG Xue-feng1, CHU Wen-bo2, ZHANG Bin1, ZHANG Da-shun3MENG Fan-jun3. Research on Hyperspectral Image Recognition of Iron Fragments[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 997-1003. |
| [2] |
HU Zheng1, ZHANG Yan1, 2*. Effect of Dimensionality Reduction and Noise Reduction on Hyperspectral Recognition During Incubation Period of Tomato Early Blight[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 744-752. |
| [3] |
XU Long-xin1, 2, 3, 4, SUN Yong-hua2, 3, 4*, WU Wen-huan1, ZOU Kai2, 3, 4, HE Shi-jun2, 3, 4, ZHAO Yuan-ming2, 3, 4, YE Miao2, 3, 4, ZHANG Xiao-han2, 3, 4. Research on Classification of Construction Waste Based on UAV Hyperspectral Image[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(12): 3927-3934. |
| [4] |
YANG Si-jie1,2, FENG Wei-wei2,3,4*, CAI Zong-qi2,3, WANG Qing2,3. Study on Rapid Recognition of Marine Microplastics Based on Raman Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(08): 2469-2473. |
| [5] |
ZHANG Xiu-lian1, 2, ZHANG Fang1, 2*, ZHOU Nuan1, 2, ZHANG Jing-jie1,2, LIU Wen-fang3, ZHANG Shuai1, 2, YANG Xiao-jie1, 2. Near-Infrared Spectral Feature Selection of Water-Bearing Rocks Based on Mutual Information[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(07): 2028-2035. |
| [6] |
LI Chen-yang1, 2, 3, CHEN Xiong-fei1, 2, 3, ZHANG Yong4, WANG Ya-wen1, 2, 3, TIAN Zhong-chao4, WANG Shi-gong4, ZHAO Zhen-yang4, LIU Ying1, 2, 3，LIU Peng-yu1, 2, 3*. Study on Identification Method Based on XGBoost Model for Aluminum Alloy Using Laser-Induced Breakdown Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(02): 624-628. |
| [7] |
HE Jin-xin1, REN Xiao-yu1, CHEN Sheng-bo2*, XIONG Yue1, XIAO Zhi-qiang1, ZHOU Hai1. Automatic Classification of Rock Spectral Features Based on Fusion Learning Model[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2021, 41(01): 141-144. |
| [8] |
ZHANG Xiao1，2, LUO A-li1*. XGBOOST Based Stellar Spectral Classification and Quantized Feature[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(10): 3292-3296. |
| [9] |
LIU Huan-jun1,2, MENG Xiang-tian1, WANG Xiang1, BAO Yi-lin1, YU Zi-yang1, ZHANG Xin-le1*. Soil Classification Model Based on the Characteristics of Soil Reflectance Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(08): 2481-2485. |
| [10] |
LI Zhi-hao, SHEN Jun*, BIAN Rui-hua, ZHENG Jian. Accuracy Comparison of the Machine Learning Algorithm Used to Raman Real Sample Collection in the Front Line of Public Security[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(07): 2171-2175. |
| [11] |
GAO Shuang, LUAN Xiao-li*, LIU Fei. Near Infrared Spectroscopy Process Pattern Fault Detection Based on Mutual Information Entropy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(06): 1736-1741. |
| [12] |
ZHOU Meng-ran, LI Da-tong*, HU Feng, LAI Wen-hao, WANG Ya, ZHU Song. Research of the AdaBoost Arithmetic in Recognition and Classifying of Mine Water Inrush Sources Fluorescence Spectrum[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 485-490. |
| [13] |
LI Ming-yang1,2, FAN Meng1*, TAO Jin-hua1, SU Lin1, WU Tong1,3, CHEN Liang-fu1, ZHANG Zi-li4. The Space-Borne Lidar Cloud and Aerosol Classification Algorithms[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2019, 39(02): 383-391. |
| [14] |
KONG Qing-qing, GONG Hui-li*, DING Xiang-qian, LIU Ming. Research on Genetic Algorithm Based on Mutual Information in the Spectrum Selection[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2018, 38(01): 31-35. |
| [15] |
HAO Yong, SUN Xu-dong, CAI Li-jun, LIU Yan-de*. Construction and Simplification of the Calibration Model for Spectral Analysis of Fuel Oil Properties Based on Mutual Information Method [J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2012, 32(01): 175-178. |
|
|
|
|
