| 光谱学与光谱分析 |
|
|
|
|
|
| Outlier Detection of Time Series Three-Dimensional Fluorescence Spectroscopy |
| YU Shao-hui1, ZHANG Yu-jun2, ZHAO Nan-jing2 |
1. School of Mathematics and Statistics, Hefei Normal University, Hefei 230061, China
2. Key Laboratory of Environmental Optics & Technology, Anhui Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Hefei 230031, China |
|
|
|
|
Abstract The qualitative and quantitative analysis are often interfered by the outliers in time series three-dimensional fluorescence spectroscopy. In this work, an efficient outlier detection method is proposed by taking advantage of the characteristics in time dimension and the spectral dimension. Firstly, the wavelength points that are mostly the outliers are extracted by the variance in time dimension. Secondly, by the analysis of the existence styles of outliers and similarity score of any two samples, the cumulative similarity is introduced in spectral dimension. At last, fluorescence intensity at each wavelength of all samples is modified by the correction matrix in time dimension and the outlier detection is completed according the to cumulative similarity scores. The application of the correction matrix in time dimension not only improves the validity of the method but also reduces the computation by the choice of characteristics region in correction matrix. Numerical experiments show that the outliers can still be detected by the 50 percent of all points in spectral dimension.
|
|
Received: 2014-03-19
Accepted: 2014-07-02
|
|
|
|
Corresponding Authors:
YU Shao-hui
E-mail: shaohuiy@hftc.edu.cn
|
|
[1] Balkis N. Water Pollution. Croatia: InTech, 2012.
[2] Mortensen P P，Bro R. Chemometrics Intelligent Laboratory System，2006, 84: 106.
[3] Bro R. Chemometrics Intelligent Laboratory System, 1999, (46)：133.
[4] Carstea E M, Baker A, Bieroza M, et al. Water Research, 2010, 44(18): 5356.
[5] Murphy K R, Hambly A, Singh S, et al. Environmental Science & Technology, 2011, 45(7): 2909.
[6] Hur J, Cho J. Sensors, 2012, 12: 972.
[7] Oto N N, Oshita S S, Makino Y Y, et al. Meat Science, 2013, 93(3): 579.
[8] Sanchez N P, Skeriotis A T, Miller C M. Water Research, 2013, 47(4): 1679.
[9] Sanchez N P, Skeriotis A T, Miller C M. Environmental Science & Technology, 2014, 48(3): 1582.
[10] Lee J S, Cox D D. Computational Statistics & Data Analysis, 2010, 54(12): 3131.
[11] Sanchez N P, Skeriotis A T, Miller C M. Water Research, 2013, 47(4): 1679.
[12] Lawaetz A J, Bro R, Nielsen M K, et al. Metabolomics, 2012, 8(1): 111.
[13] Bro R, Vidal M. Chemometrics and Intelligent Laboratory Systems, 2011, 106(1): 86.
[14] Su W X, Zhu Y L, Liu F, et al. Journal of Central South University, 2013, 20(1): 114.
[15] Gupta M, Gao J, Aggarwal C C, et al. IEEE Transactions on Knowledge and Data Engineering, 2013, 26(9): 2250. |
| [1] |
LEI Hong-jun1, YANG Guang1, PAN Hong-wei1*, WANG Yi-fei1, YI Jun2, WANG Ke-ke2, WANG Guo-hao2, TONG Wen-bin1, SHI Li-li1. Influence of Hydrochemical Ions on Three-Dimensional Fluorescence
Spectrum of Dissolved Organic Matter in the Water Environment
and the Proposed Classification Pretreatment Method[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 134-140. |
| [2] |
GU Yi-lu1, 2，PEI Jing-cheng1, 2*，ZHANG Yu-hui1, 2，YIN Xi-yan1, 2，YU Min-da1, 2, LAI Xiao-jing1, 2. Gemological and Spectral Characterization of Yellowish Green Apatite From Mexico[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2024, 44(01): 181-187. |
| [3] |
SONG Yi-ming1, 2, SHEN Jian1, 2, LIU Chuan-yang1, 2, XIONG Qiu-ran1, 2, CHENG Cheng1, 2, CHAI Yi-di2, WANG Shi-feng2，WU Jing1, 2*. Fluorescence Quantum Yield and Fluorescence Lifetime of Indole, 3-Methylindole and L-Tryptophan[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3758-3762. |
| [4] |
YANG Ke-li1, 2, PENG Jiao-yu1, 2, DONG Ya-ping1, 2*, LIU Xin1, 2, LI Wu1, 3, LIU Hai-ning1, 3. Spectroscopic Characterization of Dissolved Organic Matter Isolated From Solar Pond[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(12): 3775-3780. |
| [5] |
XUE Fang-jia, YU Jie*, YIN Hang, XIA Qi-yu, SHI Jie-gen, HOU Di-bo, HUANG Ping-jie, ZHANG Guang-xin. A Time Series Double Threshold Method for Pollution Events Detection in Drinking Water Using Three-Dimensional Fluorescence Spectroscopy[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(10): 3081-3088. |
| [6] |
JIA Yu-ge1, YANG Ming-xing1, 2*, YOU Bo-ya1, YU Ke-ye1. Gemological and Spectroscopic Identification Characteristics of Frozen Jelly-Filled Turquoise and Its Raw Material[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2974-2982. |
| [7] |
YANG Xin1, 2, XIA Min1, 2, YE Yin1, 2*, WANG Jing1, 2. Spatiotemporal Distribution Characteristics of Dissolved Organic Matter Spectrum in the Agricultural Watershed of Dianbu River[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(09): 2983-2988. |
| [8] |
ZHU Yan-ping1, CUI Chuan-jin1*, CHENG Peng-fei1, 2, PAN Jin-yan1, SU Hao1, 2, ZHANG Yi1. Measurement of Oil Pollutants by Three-Dimensional Fluorescence
Spectroscopy Combined With BP Neural Network and SWATLD[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(08): 2467-2475. |
| [9] |
QIU Cun-pu1, 2, TANG Xiao-xue2, WEN Xi-xian4, MA Xin-ling2, 3, XIA Ming-ming2, 3, LI Zhong-pei2, 3, WU Meng2, 3, LI Gui-long2, 3, LIU Kai2, 3, LIU Kai-li4, LIU Ming2, 3*. Effects of Calcium Salts on the Decomposition Process of Straw and the Characteristics of Three-Dimensional Excitation-Emission Matrices of the Dissolved Organic Matter in Decomposition Products[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(07): 2301-2307. |
| [10] |
SHI Chuan-qi1, LI Yan2, HU Yu3, YU Shao-peng1*, JIN Liang2, CHEN Mei-ru1. Fluorescence Spectral Characteristics of Soil Dissolved Organic Matter in the River Wetland of Northern Cold Region, China[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(05): 1517-1523. |
| [11] |
LI Yuan-jing1, 2, CHEN Cai-yun-fei1, 2, LI Li-ping1, 2*. Spectroscopy Study of γ-Ray Irradiated Gray Akoya Pearls[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(04): 1056-1062. |
| [12] |
LIU Xia-yan1, CAO Hao-xuan1, MIAO Chuang-he1, LI Li-jun2, ZHOU Hu1, LÜ Yi-zhong1*. Three-Dimensional Fluorescence Spectra of Dissolved Organic Matter in Fluvo-Aquic Soil Profile Under Long-Term Composting Treatment[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2023, 43(03): 674-684. |
| [13] |
ZHANG Zhe-yu, LI Yao-xiang*, WANG Zhi-yuan, LI Chun-xu. NIR Model Optimization Study of Larch Wood Density Based on IFSR Abnormal Sample Elimination[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3395-3402. |
| [14] |
LÜ Yang1, PEI Jing-cheng1*, ZHANG Yu-yang2. Chemical Composition and Spectra Characteristics of Hydrothermal Synthetic Sapphire[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(11): 3546-3551. |
| [15] |
ZHANG Yong-bin1, ZHU Dan-dan1, CHEN Ying1*, LIU Zhe1, DUAN Wei-liang1, LI Shao-hua2. Wavelength Selection Method of Algal Fluorescence Spectrum Based on Convex Point Extraction From Feature Region[J]. SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42(10): 3031-3038. |
|
|
|
|
